00000001:02000400:0.0F:1788636170.865306:0:2955:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing set_hostid 00000001:02000400:0.0:1788636182.308482:0:3157:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788636183.723959:0:3198:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 1047 MB/s 00000001:01000000:3.0F:1788636183.974066:0:3198:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 987 MB/s 00000001:01000000:2.0:1788636184.223872:0:3198:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4911 MB/s 00000020:02000000:3.0:1788636184.780518:0:3249:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_2_g6837bc1 00000400:02000000:0.0:1788636185.437256:0:3264:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.203.157@tcp [8/256/0/180] 00008000:02000000:1.0F:1788636188.646677:0:3413:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788636234.311470:0:5214:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788636243.442214:0:5791:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788636243.442220:0:5791:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788636243.442367:0:5791:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000005c3166f0 00000080:02000400:2.0:1788636243.442378:0:5791:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788636243.448979:0:5791:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788636243.448993:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788636243.449029:0:5791:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000003e0c58fa) 00000020:00000080:2.0:1788636243.449048:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788636243.468247:0:5791:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788636243.468750:0:5791:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788636243.490238:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788636243.490284:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788636243.490308:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788636243.490476:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788636243.490499:0:5791:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788636243.491720:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788636243.491728:0:5791:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788636243.491741:0:5791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa6f46 00000020:01000004:2.0:1788636243.491748:0:5791:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788636243.491751:0:5791:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788636243.491756:0:5791:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005c3166f0 from MGS 00000020:01000004:2.0:1788636243.491760:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788636243.491771:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000073f92e8d) 00000020:00000080:2.0:1788636243.491781:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788636243.491902:0:5791:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005c3166f0 from MGS, refs=2 00080000:01000000:2.0:1788636243.491908:0:5791:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788636243.491913:0:5791:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa6f54 00000100:00100000:2.0:1788636243.492021:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788636243.493733:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788636243.493744:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788636243.495113:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788636243.495122:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788636243.496468:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636243.496629:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788636243.496634:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788636243.497563:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788636243.497571:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788636243.498140:0:5791:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788636243.498147:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788636243.499163:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636243.499172:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636243.499174:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636243.499586:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636243.499588:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636243.499590:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636243.500721:0:5791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788636243.503919:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788636243.750054:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1859 MB/s 00000001:01000000:3.0:1788636244.000159:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2423 MB/s 00000001:01000000:0.0:1788636244.250648:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 663 MB/s 00000001:01000000:2.0:1788636244.501261:0:5791:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 784 MB/s 00080000:10000000:2.0:1788636244.531323:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:3.0:1788636244.543059:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788636244.549767:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788636244.549784:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788636244.549787:0:5791:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788636244.556791:0:5802:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788636244.556884:0:5791:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788636244.556935:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1788636244.557175:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788636244.557214:0:5791:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788636244.557543:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636244.557765:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788636244.557771:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788636244.559057:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788636244.559065:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788636244.559360:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788636244.559366:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1788636244.560169:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788636244.560193:0:5791:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.157@tcp' 00000020:01000004:3.0:1788636244.560205:0:5791:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788636244.560255:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.157@tcp (typ=mgc) 00000020:00000080:3.0:1788636244.560274:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.157@tcp (00000000fb778cee) 00000020:00000080:3.0:1788636244.560293:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788636244.560421:0:5791:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c2bca418@MGC192.168.203.157@tcp: add connection 192.168.203.157@tcp at head 00010000:00010000:3.0:1788636244.563333:0:5791:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.157@tcp-0 is initialized 00000040:01000000:3.0:1788636244.563341:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.157@tcp ctxt 1 is initialized 10000000:01000000:3.0:1788636244.567738:0:5808:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788636244.567788:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.157@tcp (uuid 1196c107-eaca-4490-96fc-d60d67da8edc) 00000020:00000080:3.0:1788636244.567833:0:5791:0:(genops.c:1385:class_connect()) connect: client 1196c107-eaca-4490-96fc-d60d67da8edc, cookie 0xa6aa59fb12fa6f62 00000100:00080000:3.0:1788636244.567845:0:5791:0:(import.c:545:import_select_connection()) MGC192.168.203.157@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636244.567851:0:5791:0:(import.c:665:import_select_connection()) MGC192.168.203.157@tcp: import 00000000c2bca418 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636244.567891:0:5791:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001de741e8 x1875520976322688/t0(0) o250->MGC192.168.203.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636244.568096:0:5806:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788636244.568173:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000001de741e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1196c107-eaca-4490-96fc-d60d67da8edc:3279:1875520976322688:0@lo:250: 00000100:00100000:3.0:1788636244.568272:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788636244.568761:0:5791:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 1196c107-eaca-4490-96fc-d60d67da8edc->MGS 00000020:01000004:3.0:1788636244.568784:0:5791:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788636244.568790:0:5791:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788636244.568818:0:5791:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000fd14848b) 00000020:00000080:3.0:1788636244.568831:0:5791:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788636244.578832:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976322688 00000100:00100000:1.0:1788636244.578848:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976322688 00000100:00100000:1.0:1788636244.578896:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636244.578903:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2cf02d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3279:x1875520976322688:12345-0@lo:250: 00010000:00080000:1.0:1788636244.578929:0:5803:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 1196c107-eaca-4490-96fc-d60d67da8edc@0@lo t0 exp 0000000000000000 cur 113 last 0 00000020:00000080:1.0:1788636244.578954:0:5803:0:(genops.c:1385:class_connect()) connect: client 1196c107-eaca-4490-96fc-d60d67da8edc, cookie 0xa6aa59fb12fa6f70 00000100:00080000:1.0:1788636244.579081:0:5803:0:(import.c:65:import_set_state_nolock()) 00000000e9bdebc4 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636244.579181:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2cf02d3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+5:3279:x1875520976322688:12345-0@lo:250: Request processed in 277us (10909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636244.579188:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636244.579551:0:3279:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.157@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788636244.579560:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.157@tcp: connect to target with instance 0 00000100:00080000:2.0:1788636244.579567:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788636244.579571:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788636244.579573:0:3279:0:(import.c:65:import_set_state_nolock()) 00000000c2bca418 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788636244.579577:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788636244.579584:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788636244.579588:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000001de741e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1196c107-eaca-4490-96fc-d60d67da8edc:3279:1875520976322688:0@lo:250: 00000100:00100000:3.0:1788636244.585113:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636244.585321:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788636244.585327:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788636244.586230:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636244.586238:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788636244.586855:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788636244.586863:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788636244.587562:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636244.587790:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788636244.588218:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788636244.588691:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788636244.588698:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788636244.620370:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636244.620560:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788636244.620575:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1788636244.621680:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1788636244.621688:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788636244.622271:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636244.622409:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788636244.622414:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788636244.623143:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788636244.623150:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788636244.623725:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636244.623964:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788636244.623970:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788636244.624481:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788636244.624487:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788636244.626054:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636244.626255:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788636244.626261:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788636244.626790:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788636244.626979:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:0.0:1788636244.648401:0:5791:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636244.648726:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788636244.648740:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788636244.650000:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636244.650010:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788636244.651592:0:5791:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788636244.651604:0:5791:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1788636244.652346:0:5791:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788636244.652368:0:5791:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1788636244.652373:0:5791:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788636244.652517:0:5791:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.157@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788636244.652547:0:5791:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.157@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1788636244.652552:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788636244.652554:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636244.652556:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636244.652557:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636244.652558:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636244.652559:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636244.652561:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636244.652562:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636244.652563:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788636244.652565:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788636244.652566:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636244.652568:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636244.652570:0:5791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1788636244.652572:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788636244.652574:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636244.652575:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636244.652576:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636244.652577:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636244.652578:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636244.652579:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636244.652580:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636244.652581:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788636244.652582:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788636244.652587:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636244.652588:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636244.652731:0:5791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788636244.652746:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004c7d130c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976322816:0@lo:253: 00000100:00100000:0.0:1788636244.652836:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636244.652880:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 000000005d7b5479 going to sleep for 11 seconds 00000100:00100000:2.0:1788636244.652970:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976322816 00000100:00100000:2.0:1788636244.652977:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976322816 00000100:00100000:2.0:1788636244.653023:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636244.653031:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d19510bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+5:5791:x1875520976322816:12345-0@lo:253: 20000000:01000000:2.0:1788636244.653072:0:5805:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788636244.653076:0:5805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788636244.653523:0:5805:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788636244.653898:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 10000000:01000000:2.0:1788636244.654103:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00000040:00080000:0.0:1788636244.655292:0:5827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788636244.655725:0:5805:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788636244.655729:0:5805:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788636244.655735:0:5805:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788636244.655737:0:5805:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788636244.655751:0:5805:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788636244.656251:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636244.656508:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788636244.656521:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788636244.656569:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788636244.656633:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788636244.656674:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788636244.656760:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788636244.656769:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788636244.656845:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788636244.656862:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788636244.656896:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788636244.656903:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788636244.656930:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788636244.656974:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788636244.657001:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788636244.657005:0:5805:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788636244.657017:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636244.657259:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788636244.657269:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788636244.657303:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788636244.657341:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788636244.657729:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788636244.657743:0:5805:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788636244.657912:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788636244.657922:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788636244.657967:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788636244.658002:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788636244.658033:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788636244.658043:0:5805:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788636244.658118:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788636244.658127:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788636244.658158:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788636244.658192:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788636244.658376:0:5805:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788636244.658427:0:5805:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788636244.658434:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1788636244.659147:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788636244.659432:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788636244.659525:0:5805:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.157@tcp for mdt 20000000:01000000:3.0:1788636244.659527:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.157@tcp (null) (null) (null) 00000040:00080000:3.0:1788636244.659565:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788636244.659573:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788636244.659610:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788636244.659688:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.157@tcp (null) (null) 00000040:00080000:3.0:1788636244.659739:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788636244.659750:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788636244.659784:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788636244.659994:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788636244.660060:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788636244.660063:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788636244.660067:0:5805:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788636244.660077:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788636244.660080:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788636244.660106:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788636244.660108:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788636244.660533:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1788636244.660994:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1788636244.661034:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1788636244.661106:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1788636244.661118:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788636244.661120:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788636244.662340:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788636244.662788:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788636244.662977:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788636244.663009:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788636244.663023:0:5805:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788636244.663025:0:5805:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788636244.663030:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788636244.663033:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788636244.663037:0:5805:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788636244.663044:0:5805:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788636244.663364:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1788636244.663535:0:5805:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1788636244.671658:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1788636244.671710:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1788636244.671780:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1788636244.671842:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788636244.671862:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671878:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671888:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671910:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671917:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671923:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671929:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000068a76641 already unused, calling callback (000000004dfcdb36) 00010000:00010000:0.0:1788636244.671933:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671939:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671952:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671958:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636244.671963:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788636244.671983:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788636245.008903:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d19510bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+5:5791:x1875520976322816:12345-0@lo:253: Request processed in 355865us (356059us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636245.008923:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636245.009039:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004c7d130c pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976322816:0@lo:253: 10000000:01000000:3.0:1788636245.009055:0:5791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788636245.009058:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788636245.009060:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788636245.009061:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636245.009062:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1788636245.009064:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636245.009065:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636245.009066:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788636245.009067:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788636245.009068:0:5791:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788636245.009070:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636245.009071:0:5791:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788636245.009092:0:5791:0:(tgt_mount.c:101:server_register_mount()) register mount 000000005c3166f0 from lustre-MDT0000 10000000:01000000:3.0:1788636245.009127:0:5791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1788636245.009130:0:5791:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788636245.009133:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cfd5d20cd40 10000000:01000000:3.0:1788636245.009138:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788636245.009147:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cfd5d20cd40 from 1 10000000:01000000:3.0:1788636245.009149:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788636245.009182:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: 000000000bccc3f0/0xa6aa59fb12fa6f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.009202:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: 000000000bccc3f0/0xa6aa59fb12fa6f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.009210:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: 000000000bccc3f0/0xa6aa59fb12fa6f7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636245.009228:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976322944:0@lo:101: 00000100:00100000:3.0:1788636245.009261:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636245.009319:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eea13b4 going to sleep for 11 seconds 00000100:00100000:0.0:1788636245.009423:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976322944 00000100:00100000:0.0:1788636245.009435:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976322944 00000100:00100000:0.0:1788636245.009495:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636245.009503:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed97ab78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+5:5791:x1875520976322944:12345-0@lo:101: 00010000:00010000:0.0:1788636245.009514:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636245.009525:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa6f7e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.009545:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.009554:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000068a76641/0xa6aa59fb12fa6f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.009563:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000068a76641, rc 0) 00000100:00100000:0.0:1788636245.009600:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed97ab78 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+6:5791:x1875520976322944:12345-0@lo:101: Request processed in 98us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636245.009606:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636245.009735:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976322944:0@lo:101: 00010000:00010000:3.0:1788636245.009746:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: 000000000bccc3f0/0xa6aa59fb12fa6f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.009754:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: 000000000bccc3f0/0xa6aa59fb12fa6f7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636245.009826:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323072:0@lo:501: 00000100:00100000:3.0:1788636245.009852:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636245.009869:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eea13b4 going to sleep for 11 seconds 00000100:00100000:2.0:1788636245.009927:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976323072 00000100:00100000:2.0:1788636245.009932:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976323072 00000100:00100000:2.0:1788636245.009962:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788636245.009974:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005eba462c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+6:5791:x1875520976323072:12345-0@lo:501: 00000100:00100000:2.0:1788636245.010168:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005eba462c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+6:5791:x1875520976323072:12345-0@lo:501: Request processed in 194us (316us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788636245.010175:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636245.010256:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323072:0@lo:501: 10000000:01000000:3.0:1788636245.010287:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788636245.010310:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: 000000000bccc3f0/0xa6aa59fb12fa6f7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.010319:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: 000000000bccc3f0/0xa6aa59fb12fa6f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636245.010327:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cfd613a5000 10000000:01000000:3.0:1788636245.010332:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788636245.010336:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cfd613a5000 10000000:01000000:3.0:1788636245.010338:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788636245.010341:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cfd613a5000 from 1 10000000:01000000:3.0:1788636245.010343:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788636245.010359:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: 00000000303d1b7e/0xa6aa59fb12fa6f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.010364:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: 00000000303d1b7e/0xa6aa59fb12fa6f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.010370:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: 00000000303d1b7e/0xa6aa59fb12fa6f8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636245.010380:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323200:0@lo:101: 00000100:00100000:3.0:1788636245.010402:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636245.010413:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eea13b4 going to sleep for 11 seconds 00000100:00100000:0.0:1788636245.010577:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976323200 00000100:00100000:0.0:1788636245.010582:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976323200 00000100:00100000:0.0:1788636245.010612:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636245.010618:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e3d4de2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+6:5791:x1875520976323200:12345-0@lo:101: 00010000:00010000:0.0:1788636245.010625:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636245.010636:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5e62858/0xa6aa59fb12fa6f93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa6f8c expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.010649:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5e62858/0xa6aa59fb12fa6f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f8c expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.010657:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5e62858/0xa6aa59fb12fa6f93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f8c expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.010675:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5e62858, rc 0) 00000100:00100000:0.0:1788636245.010701:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e3d4de2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+7:5791:x1875520976323200:12345-0@lo:101: Request processed in 83us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636245.010706:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636245.010820:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323200:0@lo:101: 00010000:00010000:3.0:1788636245.010830:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: 00000000303d1b7e/0xa6aa59fb12fa6f8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.010846:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: 00000000303d1b7e/0xa6aa59fb12fa6f8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636245.010857:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788636245.010869:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: 00000000303d1b7e/0xa6aa59fb12fa6f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.010876:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: 00000000303d1b7e/0xa6aa59fb12fa6f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636245.010882:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1788636245.010885:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788636245.010889:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cfd613a5000 10000000:01000000:3.0:1788636245.010891:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788636245.010894:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1788636245.010896:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788636245.010908:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: 0000000092b7d6eb/0xa6aa59fb12fa6f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.010914:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: 0000000092b7d6eb/0xa6aa59fb12fa6f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.010920:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: 0000000092b7d6eb/0xa6aa59fb12fa6f9a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636245.010931:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323328:0@lo:101: 00000100:00100000:3.0:1788636245.010954:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636245.010979:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eea13b4 going to sleep for 11 seconds 00000100:00100000:0.0:1788636245.011064:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976323328 00000100:00100000:0.0:1788636245.011068:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976323328 00000100:00100000:0.0:1788636245.011094:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788636245.011100:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000febefcd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+7:5791:x1875520976323328:12345-0@lo:101: 00010000:00010000:0.0:1788636245.011106:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636245.011112:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009556601c/0xa6aa59fb12fa6fa1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa6f9a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.011124:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009556601c/0xa6aa59fb12fa6fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.011131:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009556601c/0xa6aa59fb12fa6fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.011138:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009556601c, rc 0) 00000100:00100000:0.0:1788636245.011167:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000febefcd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+8:5791:x1875520976323328:12345-0@lo:101: Request processed in 68us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636245.011173:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636245.011275:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323328:0@lo:101: 00010000:00010000:3.0:1788636245.011284:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: 0000000092b7d6eb/0xa6aa59fb12fa6f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.011290:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: 0000000092b7d6eb/0xa6aa59fb12fa6f9a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636245.011388:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323456:0@lo:501: 00000100:00100000:3.0:1788636245.011412:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636245.011432:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eea13b4 going to sleep for 11 seconds 00000100:00100000:0.0:1788636245.011539:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976323456 00000100:00100000:0.0:1788636245.011543:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976323456 00000100:00100000:0.0:1788636245.011572:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636245.011578:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e6384b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+8:5791:x1875520976323456:12345-0@lo:501: 00000100:00100000:0.0:1788636245.011765:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e6384b4c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+9:5791:x1875520976323456:12345-0@lo:501: Request processed in 186us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636245.011777:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636245.011912:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323456:0@lo:501: 00000100:00100000:3.0:1788636245.011938:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323584:0@lo:503: 00000100:00100000:3.0:1788636245.011972:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636245.011997:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 000000004eea13b4 going to sleep for 11 seconds 00000100:00100000:2.0:1788636245.012048:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976323584 00000100:00100000:2.0:1788636245.012053:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976323584 00000100:00100000:2.0:1788636245.012081:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636245.012086:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043a3cefb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+9:5791:x1875520976323584:12345-0@lo:503: 00000100:00100000:2.0:1788636245.012239:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043a3cefb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+9:5791:x1875520976323584:12345-0@lo:503: Request processed in 153us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.012245:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636245.012420:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323584:0@lo:503: 00000100:00100000:3.0:1788636245.012883:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:5833:1875520976323712:0@lo:502: 00000100:00100000:3.0:1788636245.012920:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636245.012948:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000ad349e8c going to sleep for 11 seconds 00000100:00100000:2.0:1788636245.012998:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976323712 00000100:00100000:2.0:1788636245.013003:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976323712 00000100:00100000:2.0:1788636245.013033:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636245.013039:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa87b356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+9:5833:x1875520976323712:12345-0@lo:502: 00000100:00100000:2.0:1788636245.013171:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa87b356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+9:5833:x1875520976323712:12345-0@lo:502: Request processed in 132us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.013178:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636245.013296:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fc1bfa55 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:5833:1875520976323712:0@lo:502: 00000020:01000000:0.0:1788636245.013386:0:5833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636245.013397:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636245.013399:0:5833:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788636245.013404:0:5833:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788636245.013407:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636245.013425:0:5833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000042caadc0) 00000020:00000080:0.0:1788636245.013504:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788636245.013512:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788636245.013604:0:5833:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788636245.013611:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa6faf 00000020:00000080:0.0:1788636245.013883:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788636245.013887:0:5833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636245.013892:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636245.013893:0:5833:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788636245.013896:0:5833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636245.013900:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636245.013901:0:5833:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788636245.013904:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636245.013910:0:5833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000c851fe81) 00000020:00000080:0.0:1788636245.013919:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788636245.013923:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788636245.013925:0:5833:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788636245.013927:0:5833:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788636245.013932:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788636245.013970:0:5833:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005c3166f0 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788636245.013980:0:5833:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000f5f4043b) 00000020:00000080:0.0:1788636245.013986:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788636245.014038:0:5833:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788636245.014043:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa6fc4 00000020:00000080:0.0:1788636245.014150:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788636245.014155:0:5833:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788636245.014159:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa6aa59fb12fa6fcb 00080000:01000000:0.0:1788636245.014164:0:5833:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788636245.014166:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa6fd2 00080000:10000000:0.0:1788636245.015184:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1788636245.015725:0:5833:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1788636245.020744:0:5833:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788636245.120556:0:5833:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788636245.120947:0:5833:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788636245.124072:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788636245.124532:0:5833:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788636245.156167:0:5833:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009640bd93) 00000020:00000080:3.0:1788636245.156187:0:5833:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788636245.156366:0:5833:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788636245.156373:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa6fe0 00000020:00000080:2.0:1788636245.158604:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:2.0:1788636245.160136:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636245.211107:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636245.268023:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636245.311760:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636245.362091:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636245.399357:0:5833:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788636245.436709:0:5833:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa6aa59fb12fa6fe7 00000020:00000080:3.0:1788636245.437567:0:5833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788636245.437577:0:5833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636245.437583:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636245.437585:0:5833:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788636245.437588:0:5833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636245.437592:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636245.437594:0:5833:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788636245.437596:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788636245.437598:0:5833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788636245.437600:0:5833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636245.437602:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636245.437603:0:5833:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788636245.437605:0:5833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636245.437609:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636245.437610:0:5833:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788636245.437614:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788636245.437647:0:5833:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:3.0:1788636245.437696:0:5833:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000090ed1e41 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:5833:1875520976323840:0@lo:502: 00000100:00100000:3.0:1788636245.437881:0:5833:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636245.437925:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976323840 00000100:00100000:0.0:1788636245.437932:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976323840 00000100:00100000:0.0:1788636245.437970:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636245.437978:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a9aeabe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+9:5833:x1875520976323840:12345-0@lo:502: 00000100:00100000:2.0:1788636245.438180:0:5833:0:(client.c:2716:ptlrpc_set_wait()) set 00000000c1e73c32 going to sleep for 11 seconds 00000100:00100000:1.0:1788636245.439557:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a9aeabe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+9:5833:x1875520976323840:12345-0@lo:502: Request processed in 1577us (1784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636245.439568:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636245.439747:0:5833:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000090ed1e41 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:5833:1875520976323840:0@lo:502: 00000020:01000000:2.0:1788636245.439778:0:5833:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636245.439784:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636245.439786:0:5833:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788636245.439790:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:0.0:1788636245.439881:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:0.0:1788636245.439900:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788636245.439922:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: 0000000092b7d6eb/0xa6aa59fb12fa6f9a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.439932:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: 0000000092b7d6eb/0xa6aa59fb12fa6f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636245.439939:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cfd613a5000 from 1 10000000:01000000:0.0:1788636245.439942:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788636245.439966:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.439973:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.439981:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636245.439997:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c718991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323968:0@lo:101: 00000100:00100000:0.0:1788636245.440035:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636245.440069:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089ce259b going to sleep for 11 seconds 00000100:00100000:2.0:1788636245.440122:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976323968 00000100:00100000:2.0:1788636245.440134:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976323968 00000100:00100000:2.0:1788636245.440283:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636245.440291:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce14c634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+9:5791:x1875520976323968:12345-0@lo:101: 00010000:00010000:2.0:1788636245.440313:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636245.440521:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa6fee expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.440556:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.440578:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.440587:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000084b71135, rc 0) 00000100:00100000:2.0:1788636245.440720:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce14c634 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+10:5791:x1875520976323968:12345-0@lo:101: Request processed in 419us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.440727:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636245.440825:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c718991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976323968:0@lo:101: 00010000:00010000:0.0:1788636245.440847:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.440856:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636245.441960:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000007c718991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324096:0@lo:256: 00000100:00100000:0.0:1788636245.442042:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636245.442761:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976324096 00000100:00100000:1.0:1788636245.442768:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976324096 00000100:00100000:1.0:1788636245.442860:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788636245.442867:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000eaee3894 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+10:5791:x1875520976324096:12345-0@lo:256: 20000000:01000000:1.0:1788636245.442884:0:5804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788636245.442889:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788636245.442948:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000eaee3894 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+10:5791:x1875520976324096:12345-0@lo:256: Request processed in 82us (906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636245.442954:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788636245.443058:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 0000000089ce259b going to sleep for 11 seconds 00000100:00100000:1.0:1788636245.443075:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000007c718991 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324096:0@lo:256: 10000000:01000000:1.0:1788636245.443759:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788636245.443885:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636245.443896:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636245.443903:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613a5000 from 1 10000000:01000000:1.0:1788636245.443906:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636245.443940:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636245.443947:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636245.443955:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636245.443969:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324224:0@lo:101: 00000100:00100000:1.0:1788636245.443998:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636245.444022:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005395b41 going to sleep for 11 seconds 00000100:00100000:2.0:1788636245.444034:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976324224 00000100:00100000:2.0:1788636245.444041:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976324224 00000100:00100000:2.0:1788636245.444080:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636245.444096:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f70a728 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+10:5791:x1875520976324224:12345-0@lo:101: 00010000:00010000:2.0:1788636245.444112:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636245.444123:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa6ffc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.444149:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.444157:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.444177:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ed0aa84b, rc 0) 00000100:00100000:2.0:1788636245.444230:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f70a728 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+11:5791:x1875520976324224:12345-0@lo:101: Request processed in 144us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.444236:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788636245.444269:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324224:0@lo:101: 00010000:00010000:1.0:1788636245.444281:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636245.444289:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636245.444343:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324352:0@lo:501: 00000100:00100000:1.0:1788636245.444374:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636245.444395:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005395b41 going to sleep for 11 seconds 00000100:00100000:3.0:1788636245.444497:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976324352 00000100:00100000:3.0:1788636245.444502:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976324352 00000100:00100000:3.0:1788636245.444565:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636245.444572:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004af62ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+11:5791:x1875520976324352:12345-0@lo:501: 00000100:00100000:3.0:1788636245.444978:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004af62ec4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+11:5791:x1875520976324352:12345-0@lo:501: Request processed in 407us (604us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636245.444993:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636245.445058:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324352:0@lo:501: 00000100:00100000:1.0:1788636245.445084:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324480:0@lo:503: 00000100:00100000:1.0:1788636245.445117:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636245.445502:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005395b41 going to sleep for 11 seconds 00000100:00100000:0.0:1788636245.445547:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976324480 00000100:00100000:0.0:1788636245.445552:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976324480 00000100:00100000:0.0:1788636245.445589:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788636245.445596:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008263bad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:5791:x1875520976324480:12345-0@lo:503: 00000040:00080000:0.0:1788636245.445629:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788636245.445675:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008263bad3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:5791:x1875520976324480:12345-0@lo:503: Request processed in 80us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636245.445682:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636245.445766:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324480:0@lo:503: 00000040:00080000:1.0:1788636245.447454:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1788636245.448248:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1788636245.448265:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636245.448280:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.448292:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636245.448347:0:5791:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788636245.448360:0:5791:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cfd613a5000 10000000:01000000:0.0:1788636245.448363:0:5791:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cfd613a5000 10000000:01000000:0.0:1788636245.448367:0:5791:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788636245.448373:0:5791:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd613a5000 from 1 10000000:01000000:0.0:1788636245.448375:0:5791:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788636245.448405:0:5791:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: 00000000c2bc94fd/0xa6aa59fb12fa700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.448413:0:5791:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: 00000000c2bc94fd/0xa6aa59fb12fa700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.448422:0:5791:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: 00000000c2bc94fd/0xa6aa59fb12fa700a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636245.448441:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059188c73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324608:0@lo:101: 00000100:00100000:0.0:1788636245.448491:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636245.448530:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2626af4 going to sleep for 11 seconds 00000100:00100000:3.0:1788636245.448583:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976324608 00000100:00100000:3.0:1788636245.448590:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976324608 00000100:00100000:3.0:1788636245.448629:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636245.448636:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000016a9c311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:5791:x1875520976324608:12345-0@lo:101: 00010000:00010000:3.0:1788636245.448647:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636245.448659:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000066c38d54/0xa6aa59fb12fa7011 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa700a expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.448679:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066c38d54/0xa6aa59fb12fa7011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.448688:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000066c38d54/0xa6aa59fb12fa7011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.448696:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000066c38d54, rc 0) 00000100:00100000:3.0:1788636245.448740:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000016a9c311 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:5791:x1875520976324608:12345-0@lo:101: Request processed in 105us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636245.448746:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788636245.451536:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059188c73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324608:0@lo:101: 00010000:00010000:0.0:1788636245.451561:0:5791:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: 00000000c2bc94fd/0xa6aa59fb12fa700a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.451572:0:5791:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: 00000000c2bc94fd/0xa6aa59fb12fa700a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636245.451637:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059188c73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324736:0@lo:501: 00000100:00100000:0.0:1788636245.451685:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636245.451723:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2626af4 going to sleep for 11 seconds 00000100:00100000:2.0:1788636245.451777:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976324736 00000100:00100000:2.0:1788636245.451783:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976324736 00000100:00100000:2.0:1788636245.451855:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636245.451863:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007986b63e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5791:x1875520976324736:12345-0@lo:501: 00000100:00100000:2.0:1788636245.452099:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007986b63e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5791:x1875520976324736:12345-0@lo:501: Request processed in 236us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.452106:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636245.454453:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059188c73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324736:0@lo:501: 00000100:00100000:0.0:1788636245.454553:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000059188c73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324864:0@lo:503: 00000100:00100000:0.0:1788636245.454620:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636245.454653:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 00000000e2626af4 going to sleep for 11 seconds 00000100:00100000:1.0:1788636245.455115:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976324864 00000100:00100000:1.0:1788636245.455121:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976324864 00000100:00100000:1.0:1788636245.455155:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636245.455160:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c6262b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:5791:x1875520976324864:12345-0@lo:503: 00000100:00100000:1.0:1788636245.455520:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c6262b71 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:5791:x1875520976324864:12345-0@lo:503: Request processed in 358us (899us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636245.455527:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788636245.455695:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000059188c73 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976324864:0@lo:503: 00000100:00100000:1.0:1788636245.456787:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:5838:1875520976324992:0@lo:502: 00000100:00100000:1.0:1788636245.456867:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636245.456896:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cb0110bf going to sleep for 11 seconds 00000100:00100000:2.0:1788636245.457143:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976324992 00000100:00100000:2.0:1788636245.457150:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976324992 00000100:00100000:2.0:1788636245.457246:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788636245.457255:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051907fee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5838:x1875520976324992:12345-0@lo:502: 00000100:00100000:2.0:1788636245.457674:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051907fee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5838:x1875520976324992:12345-0@lo:502: Request processed in 421us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.457682:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636245.457746:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:5838:1875520976324992:0@lo:502: 00000020:01000004:1.0:1788636245.457903:0:5838:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1788636245.457925:0:5838:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b7d228b3) 00000020:00000080:1.0:1788636245.457943:0:5838:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1788636245.458056:0:5838:0:(tgt_mount.c:153:server_get_mount()) get mount 000000005c3166f0 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788636245.458069:0:5838:0:(tgt_mount.c:187:server_put_mount()) put mount 000000005c3166f0 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1788636245.458072:0:5838:0:(obd_mount.c:710:lustre_put_lsi()) put 000000005c3166f0 4 00010000:00080000:1.0:1788636245.458098:0:5838:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000003f000b3@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.157@tcp at head 00010000:00010000:1.0:1788636245.461948:0:5838:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1788636245.462448:0:5838:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788636245.462481:0:5838:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788636245.462493:0:5838:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa6aa59fb12fa701f 00000100:00080000:1.0:1788636245.462502:0:5838:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636245.462507:0:5838:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000003f000b3 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:1.0:1788636245.462543:0:5838:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000de849644 x1875520976325120/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788636245.462571:0:5838:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788636245.463213:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976325120:0@lo:38: 00000100:00100000:3.0:1788636245.463275:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636245.463601:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce3fb9d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:5838:1875520976325248:0@lo:502: 00000100:00100000:1.0:1788636245.463647:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636245.463675:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976325248 00000100:00100000:1.0:1788636245.463681:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976325248 00000100:00100000:1.0:1788636245.463717:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788636245.463725:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ea8ea44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:5838:x1875520976325248:12345-0@lo:502: 00000100:00100000:1.0:1788636245.463952:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ea8ea44 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:5838:x1875520976325248:12345-0@lo:502: Request processed in 228us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636245.463960:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788636245.464004:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set 0000000005395b41 going to sleep for 11 seconds 00000100:00100000:1.0:1788636245.464021:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce3fb9d3 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:5838:1875520976325248:0@lo:502: 00000040:00080000:1.0:1788636245.464044:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1788636245.464427:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976325120 00000100:00100000:0.0:1788636245.464433:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976325120 00000100:00100000:0.0:1788636245.464494:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636245.464499:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009385a8fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1875520976325120:12345-0@lo:38: 00000100:00100000:0.0:1788636245.464569:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009385a8fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1875520976325120:12345-0@lo:38: Request processed in 68us (1293us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788636245.464576:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636245.464626:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636245.464632:0:3279:0:(import.c:65:import_set_state_nolock()) 0000000003f000b3 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636245.464636:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788636245.464640:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976325120:0@lo:38: 00000020:01000000:2.0:1788636245.465022:0:5791:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:2.0:1788636245.465043:0:5791:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788636245.465057:0:5791:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: 00000000c2bc94fd/0xa6aa59fb12fa700a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.465067:0:5791:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: 00000000c2bc94fd/0xa6aa59fb12fa700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788636245.465123:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788636245.465126:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788636245.465127:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636245.465129:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636245.465130:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636245.465132:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636245.465133:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636245.465134:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788636245.465136:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636245.465137:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636245.465139:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636245.465140:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636245.465144:0:5791:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:2.0:1788636245.465147:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636245.465148:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788636245.465149:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636245.465150:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636245.465151:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636245.465152:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636245.465153:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788636245.465154:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788636245.465155:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636245.465156:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636245.465157:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636245.465158:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636245.465186:0:5791:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788636245.465211:0:5791:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000c4cda96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976325376:0@lo:253: 00000100:00100000:2.0:1788636245.465244:0:5791:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636245.465373:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976325376 00000100:00100000:2.0:1788636245.465376:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976325376 00000100:00100000:2.0:1788636245.465403:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788636245.465407:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ded49cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5791:x1875520976325376:12345-0@lo:253: 20000000:01000000:2.0:1788636245.465424:0:5803:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788636245.465436:0:5803:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788636245.466568:0:5791:0:(client.c:2716:ptlrpc_set_wait()) set 000000003d2eabff going to sleep for 11 seconds 20000000:01000000:2.0:1788636245.496819:0:5803:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788636245.496837:0:5803:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1788636245.496881:0:5826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788636245.496886:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788636245.496914:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.496932:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.496940:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.496974:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636245.496988:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 12 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636245.497000:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ba617ad pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1875520976325504:0@lo:104: 00000100:00100000:0.0:1788636245.497068:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636245.497116:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set 000000004136ff29 going to sleep for 11 seconds 00000100:00100000:2.0:1788636245.497331:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976325504 00000100:00100000:2.0:1788636245.497338:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976325504 00000100:00100000:2.0:1788636245.497388:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636245.497396:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000034d500b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:5826:x1875520976325504:12345-0@lo:104: 00010000:00010000:2.0:1788636245.497408:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.497461:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636245.497466:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000034d500b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:5826:x1875520976325504:12345-0@lo:104: Request processed in 71us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.497473:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636245.497586:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ba617ad pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1875520976325504:0@lo:104: 00010000:00010000:0.0:1788636245.497679:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.497742:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636245.497749:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.497755:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003a5f4e3e already unused, calling callback (00000000638fe520) 10000000:00010000:3.0:1788636245.497763:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.497770:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636245.497776:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636245.497781:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788636245.497833:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.497841:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636245.497865:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.497872:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: 000000003a5f4e3e/0xa6aa59fb12fa6fee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6ff5 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636245.497888:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636245.497889:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636245.497891:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636245.498037:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636245.498047:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c6a7509 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976325632:0@lo:103: 00000100:00100000:3.0:1788636245.498138:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636245.501500:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976325632 00000100:00100000:2.0:1788636245.501512:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976325632 00010000:00010000:2.0:1788636245.501545:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 13 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636245.501577:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636245.501585:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076872270 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+13:3280:x1875520976325632:12345-0@lo:103: 00010000:00010000:2.0:1788636245.501597:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636245.501602:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 13 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501625:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 13 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501642:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000084b71135/0xa6aa59fb12fa6ff5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa6fee expref: 13 pid: 5803 timeout: 264 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501668:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501676:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788636245.501691:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004805342s 00010000:00010000:2.0:1788636245.501695:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501701:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501706:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501712:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501717:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b1788f05 already unused, calling callback (000000004dfcdb36) 00010000:00010000:2.0:1788636245.501720:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501727:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501742:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501752:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636245.501842:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076872270 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+12:3280:x1875520976325632:12345-0@lo:103: Request processed in 258us (3703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.501850:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1788636245.501973:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501982:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636245.501987:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b1788f05/0xa6aa59fb12fa7026 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636245.502481:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c6a7509 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976325632:0@lo:103: 00000100:00100000:2.0:1788636245.510487:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ded49cb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+11:5791:x1875520976325376:12345-0@lo:253: Request processed in 45072us (45235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636245.510501:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636245.510582:0:5791:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000c4cda96b pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:5791:1875520976325376:0@lo:253: 10000000:01000000:0.0:1788636245.510597:0:5791:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788636245.510600:0:5791:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788636245.510602:0:5791:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636245.510603:0:5791:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636245.510604:0:5791:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636245.510669:0:5791:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636245.510671:0:5791:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636245.510672:0:5791:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636245.510673:0:5791:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636245.510675:0:5791:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788636245.510676:0:5791:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788636245.510677:0:5791:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636245.510678:0:5791:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788636245.510692:0:5791:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788636245.520387:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636245.520920:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788636245.521447:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636245.521748:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788636245.522030:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636245.522371:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1788636245.523002:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636245.523360:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1788636245.523568:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636245.526278:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1788636245.531510:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636245.532027:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:3.0:1788636245.571184:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:2.0:1788636245.580509:0:5791:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788636245.613932:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1788636245.614420:0:5844:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:3.0:1788636245.615177:0:5843:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788636245.615182:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1788636245.617734:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788636245.617916:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788636245.621690:0:5791:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788636245.621706:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788636245.621940:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636245.627265:0:5791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788636245.629072:0:5791:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788636245.629118:0:5791:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788636245.630010:0:5791:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1788636245.630608:0:5791:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1788636245.637111:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1788636245.638781:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1788636245.639330:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1788636245.641334:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1788636245.641911:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1788636245.642063:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1788636245.642209:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788636245.644503:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788636245.644730:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788636245.644885:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788636245.645154:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788636245.645310:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788636245.645449:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788636245.645708:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788636245.646038:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788636245.646209:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788636245.646428:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788636245.646523:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788636245.646716:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788636245.646887:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788636245.647133:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788636245.647319:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788636245.647477:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788636245.647708:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788636245.647971:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788636245.648158:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788636245.648498:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788636245.648768:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788636245.648956:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788636245.649277:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788636245.649465:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788636245.649672:0:5791:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788636245.649929:0:5791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788636245.672677:0:5844:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636245.714360:0:5844:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788636245.714435:0:5844:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788636245.714440:0:5844:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000001:00080000:2.0:1788636245.714627:0:5791:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788636245.714648:0:5791:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0a5c1937988 00100000:10000000:2.0:1788636245.714657:0:5791:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788636245.715682:0:5791:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788636245.715695:0:5791:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788636245.715710:0:5791:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788636245.715724:0:5791:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788636246.601601:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636247.617134:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636248.639077:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636249.673717:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788636250.656831:0:6087:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788636250.688100:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636250.752642:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788636250.752651:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788636250.752654:0:38:0:(import.c:65:import_set_state_nolock()) 0000000003f000b3 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788636250.752665:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000003f000b3 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:1.0:1788636250.752685:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ce3fb9d3 x1875520976325888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636250.752718:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce3fb9d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976325888:0@lo:38: 00000100:00100000:1.0:1788636250.752777:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636250.753056:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976325760:0@lo:400: 00000100:00100000:3.0:1788636250.753095:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636250.753215:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976325888 00000100:00100000:2.0:1788636250.753223:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976325888 00000100:00100000:2.0:1788636250.753363:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636250.753370:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000aede27dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1875520976325888:12345-0@lo:38: 00010000:00080000:2.0:1788636250.753395:0:5812:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 119 last 0 00000020:00000080:2.0:1788636250.753429:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa6aa59fb12fa702d 00000004:00100000:2.0:1788636250.753472:0:5812:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788636250.753599:0:5812:0:(import.c:65:import_set_state_nolock()) 0000000005c14eb4 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636250.753650:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000aede27dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875520976325888:12345-0@lo:38: Request processed in 279us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636250.753658:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636250.753791:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976325760 00000100:00100000:1.0:1788636250.753813:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976325760 00000100:00100000:1.0:1788636250.753847:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636250.753855:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de04ddb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:3282:x1875520976325760:12345-0@lo:400: 00000100:00100000:1.0:1788636250.753896:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de04ddb4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:3282:x1875520976325760:12345-0@lo:400: Request processed in 43us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636250.753902:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636250.753943:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000de849644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976325760:0@lo:400: 00010000:00080000:1.0:1788636250.753972:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ce3fb9d3 x1875520976325888/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636260 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788636250.753985:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788636250.753991:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788636250.753995:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788636250.753997:0:3279:0:(import.c:65:import_set_state_nolock()) 0000000003f000b3 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636250.754002:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce3fb9d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976325888:0@lo:38: 00010000:00010000:1.0:1788636251.716674:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788636251.774955:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788636251.774962:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cfd613a5000 from 3 10000000:01000000:0.0:1788636251.774966:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788636251.775005:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: 00000000b1788f05/0xa6aa59fb12fa7034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636251.775017:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: 00000000b1788f05/0xa6aa59fb12fa7034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636251.775026:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: 00000000b1788f05/0xa6aa59fb12fa7034 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636251.775048:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000ba617ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326016:0@lo:101: 00000100:00100000:0.0:1788636251.775112:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636251.775185:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set 00000000efb84871 going to sleep for 11 seconds 00000100:00100000:2.0:1788636251.775532:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976326016 00000100:00100000:2.0:1788636251.775541:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976326016 00000100:00100000:2.0:1788636251.775597:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788636251.775608:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009529f6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+11:5808:x1875520976326016:12345-0@lo:101: 00010000:00010000:2.0:1788636251.775619:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636251.775634:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e3dcabbc/0xa6aa59fb12fa703b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7034 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636251.775666:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e3dcabbc/0xa6aa59fb12fa703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636251.775677:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e3dcabbc/0xa6aa59fb12fa703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636251.775686:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e3dcabbc, rc 0) 00000100:00100000:2.0:1788636251.775735:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009529f6b0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976326016:12345-0@lo:101: Request processed in 130us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636251.775743:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788636251.775826:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000ba617ad pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326016:0@lo:101: 00010000:00010000:2.0:1788636251.775843:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: 00000000b1788f05/0xa6aa59fb12fa7034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636251.775853:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: 00000000b1788f05/0xa6aa59fb12fa7034 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636251.775910:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326144:0@lo:256: 00000100:00100000:2.0:1788636251.775940:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636251.775957:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set 0000000078981d63 going to sleep for 11 seconds 00000100:00100000:2.0:1788636251.775970:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976326144 00000100:00100000:2.0:1788636251.775974:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976326144 00000100:00100000:2.0:1788636251.775996:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636251.776003:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005f8d82c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976326144:12345-0@lo:256: 20000000:01000000:2.0:1788636251.776014:0:5804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788636251.776028:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788636251.776032:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788636251.776103:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005f8d82c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976326144:12345-0@lo:256: Request processed in 101us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636251.776110:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636251.776161:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326144:0@lo:256: 10000000:01000000:2.0:1788636251.776198:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788636251.776204:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: 00000000b1788f05/0xa6aa59fb12fa7034 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636251.778056:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: 00000000b1788f05/0xa6aa59fb12fa7034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636252.735071:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636253.759060:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636254.785020:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788636255.084538:0:6289:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc9410a8f0 20000000:00000080:3.0:1788636255.084556:0:6289:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cfd76a0e800 uarg=0000000000000000 20000000:01000000:3.0:1788636255.084587:0:6289:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788636255.084594:0:6289:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788636255.084599:0:6289:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788636255.084873:0:6289:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788636255.084884:0:6289:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788636255.088411:0:6289:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636255.088666:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788636255.088720:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788636255.088766:0:6289:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788636255.088782:0:6289:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788636255.088972:0:6289:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636255.088998:0:6289:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636255.089006:0:6289:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636255.089041:0:6289:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636255.089055:0:6289:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 11 pid: 5803 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636255.089079:0:6289:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000002c6a7509 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6289:1875520976326272:0@lo:104: 00000100:00100000:3.0:1788636255.089150:0:6289:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636255.089202:0:6289:0:(client.c:2716:ptlrpc_set_wait()) set 0000000047b1b2a7 going to sleep for 11 seconds 00000100:00100000:2.0:1788636255.089378:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976326272 00000100:00100000:2.0:1788636255.089388:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976326272 00000100:00100000:2.0:1788636255.089440:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636255.089449:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034356dc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:6289:x1875520976326272:12345-0@lo:104: 00010000:00010000:2.0:1788636255.089460:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089522:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636255.089527:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034356dc7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:6289:x1875520976326272:12345-0@lo:104: Request processed in 80us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636255.089534:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788636255.089552:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636255.089556:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089563:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e21d702 already unused, calling callback (00000000638fe520) 10000000:00010000:2.0:1788636255.089566:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089578:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636255.089584:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636255.089589:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788636255.089611:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089618:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636255.089634:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089640:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: 000000003e21d702/0xa6aa59fb12fa6ffc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7003 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089658:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636255.089659:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636255.089661:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636255.089677:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976326400:0@lo:103: 00000100:00100000:2.0:1788636255.089705:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636255.089737:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976326400 00000100:00100000:2.0:1788636255.089741:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976326400 00010000:00010000:2.0:1788636255.089755:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 12 pid: 5803 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636255.089774:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636255.089779:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005a4c30a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+12:3283:x1875520976326400:12345-0@lo:103: 00010000:00010000:2.0:1788636255.089819:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636255.089825:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 12 pid: 5803 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089835:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 12 pid: 5803 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089849:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089856:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089868:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089875:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089880:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089885:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089889:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000990df8b2 already unused, calling callback (000000004dfcdb36) 00010000:00010000:2.0:1788636255.089892:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089898:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089917:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636255.089927:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636255.089953:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005a4c30a5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+12:3283:x1875520976326400:12345-0@lo:103: Request processed in 175us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636255.089959:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636255.090006:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976326400:0@lo:103: 00010000:00010000:0.0:1788636255.090259:0:6289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ed0aa84b/0xa6aa59fb12fa7003 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa6ffc expref: 11 pid: 5803 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636255.090270:0:6289:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000002c6a7509 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6289:1875520976326272:0@lo:104: 00010000:00010000:0.0:1788636255.090283:0:6289:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636255.090290:0:6289:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636255.090295:0:6289:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636255.090306:0:6289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000990df8b2/0xa6aa59fb12fa7042 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6289 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636255.806964:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636255.871072:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636255.871099:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000ce3fb9d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976326528:0@lo:400: 00000100:00100000:0.0:1788636255.871184:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636255.871314:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976326528 00000100:00100000:1.0:1788636255.871322:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976326528 00000100:00100000:1.0:1788636255.871368:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636255.871376:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000697e509a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976326528:12345-0@lo:400: 00000100:00100000:1.0:1788636255.871450:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000697e509a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976326528:12345-0@lo:400: Request processed in 75us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636255.871457:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788636255.871696:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000ce3fb9d3 x1875520976326528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636255.871708:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000ce3fb9d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976326528:0@lo:400: 00010000:00010000:2.0:1788636256.832908:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788636257.665756:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636257.665764:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613a5000 from 1 10000000:01000000:2.0:1788636257.665769:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636257.665835:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: 00000000cd5b2772/0xa6aa59fb12fa7049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636257.665847:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: 00000000cd5b2772/0xa6aa59fb12fa7049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636257.665858:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: 00000000cd5b2772/0xa6aa59fb12fa7049 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636257.665882:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326656:0@lo:101: 00000100:00100000:2.0:1788636257.665946:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636257.666047:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set 000000002f58254f going to sleep for 11 seconds 00000100:00100000:2.0:1788636257.666068:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976326656 00000100:00100000:2.0:1788636257.666075:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976326656 00000100:00100000:2.0:1788636257.666130:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788636257.666139:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006294af98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+11:5808:x1875520976326656:12345-0@lo:101: 00010000:00010000:2.0:1788636257.666162:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636257.666174:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f9b28c14/0xa6aa59fb12fa7050 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7049 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636257.666195:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f9b28c14/0xa6aa59fb12fa7050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636257.666205:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f9b28c14/0xa6aa59fb12fa7050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636257.666223:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f9b28c14, rc 0) 00000100:00100000:2.0:1788636257.666595:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006294af98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976326656:12345-0@lo:101: Request processed in 457us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636257.666603:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788636257.666865:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326656:0@lo:101: 00010000:00010000:2.0:1788636257.666880:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: 00000000cd5b2772/0xa6aa59fb12fa7049 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636257.666889:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: 00000000cd5b2772/0xa6aa59fb12fa7049 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636257.666986:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326784:0@lo:501: 00000100:00100000:2.0:1788636257.667013:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636257.671589:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4b81cb6 going to sleep for 11 seconds 00000100:00100000:0.0:1788636257.671957:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976326784 00000100:00100000:0.0:1788636257.671967:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976326784 00000100:00100000:0.0:1788636257.672018:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788636257.672027:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007cb890f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976326784:12345-0@lo:501: 00000100:00100000:0.0:1788636257.672760:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007cb890f1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976326784:12345-0@lo:501: Request processed in 733us (5745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636257.672770:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636257.672942:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326784:0@lo:501: 00000100:00100000:2.0:1788636257.672987:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326912:0@lo:503: 00000100:00100000:2.0:1788636257.673032:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636257.673270:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set 00000000f4b81cb6 going to sleep for 11 seconds 00000100:00100000:2.0:1788636257.673284:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976326912 00000100:00100000:2.0:1788636257.673289:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976326912 00000100:00100000:2.0:1788636257.673318:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788636257.673324:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e85b1f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976326912:12345-0@lo:503: 00000100:00100000:2.0:1788636257.673762:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e85b1f9a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976326912:12345-0@lo:503: Request processed in 438us (729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636257.673769:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788636257.673871:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000bc1fc473 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976326912:0@lo:503: 00000100:00100000:3.0:1788636257.674389:0:6408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000078270dde pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6408:1875520976327040:0@lo:502: 00000100:00100000:3.0:1788636257.674566:0:6408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636257.674596:0:6408:0:(client.c:2716:ptlrpc_set_wait()) set 000000005028c267 going to sleep for 11 seconds 00000100:00100000:2.0:1788636257.674635:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976327040 00000100:00100000:2.0:1788636257.674640:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976327040 00000100:00100000:2.0:1788636257.674667:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788636257.674673:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004aed2ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:6408:x1875520976327040:12345-0@lo:502: 00000100:00100000:2.0:1788636257.674988:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004aed2ee3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:6408:x1875520976327040:12345-0@lo:502: Request processed in 315us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636257.674995:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636257.675137:0:6408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000078270dde pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6408:1875520976327040:0@lo:502: 00000020:01000000:3.0:1788636257.675159:0:6408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636257.675168:0:6408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636257.675169:0:6408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788636257.675175:0:6408:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd613a5000 00000020:00000080:3.0:1788636257.675177:0:6408:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788636257.675210:0:6408:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d297480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6408:1875520976327168:0@lo:502: 00000100:00100000:3.0:1788636257.675306:0:6408:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636257.675331:0:6408:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd51335240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636257.675372:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976327168 00000100:00100000:1.0:1788636257.675377:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976327168 00000100:00100000:1.0:1788636257.675553:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788636257.675564:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:6408:x1875520976327168:12345-0@lo:502: 00000100:00100000:1.0:1788636257.675705:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:6408:x1875520976327168:12345-0@lo:502: Request processed in 142us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636257.675711:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788636257.675786:0:6408:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d297480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6408:1875520976327168:0@lo:502: 00000020:01000000:2.0:1788636257.675836:0:6408:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636257.675841:0:6408:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636257.675842:0:6408:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788636257.675846:0:6408:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788636257.675897:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788636257.675913:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636257.675922:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636257.675933:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636257.854871:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636258.878916:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636259.904192:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636260.929455:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636260.993550:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976327424:0@lo:400: 00000100:00100000:0.0:1788636260.993617:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636260.993701:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976327424 00000100:00100000:0.0:1788636260.993709:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976327424 00000100:00100000:0.0:1788636260.994179:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636260.994190:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976327424:12345-0@lo:400: 00000100:00100000:0.0:1788636260.994252:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976327424:12345-0@lo:400: Request processed in 64us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636260.994271:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788636260.994313:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cfd756a5f80 x1875520976327424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636260.994327:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976327424:0@lo:400: 00000100:00100000:3.0:1788636260.994406:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976327296:0@lo:400: 00000100:00100000:3.0:1788636260.994446:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636260.995721:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976327296 00000100:00100000:0.0:1788636260.995731:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976327296 00000100:00100000:0.0:1788636260.995779:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636260.995827:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:3281:x1875520976327296:12345-0@lo:400: 00000100:00100000:0.0:1788636260.995899:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:3281:x1875520976327296:12345-0@lo:400: Request processed in 111us (1452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636260.995906:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788636260.995995:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976327296:0@lo:400: 00000020:01000004:2.0:1788636261.406065:0:6657:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788636261.406069:0:6657:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788636261.406513:0:6657:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cfd76a12000 00000020:01000004:2.0:1788636261.406530:0:6657:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788636261.406542:0:6657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788636261.406556:0:6657:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cfd48dcb380) 00000020:00000080:2.0:1788636261.406589:0:6657:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788636261.419988:0:6657:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788636261.420409:0:6657:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788636261.439115:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788636261.446162:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788636261.446387:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788636261.446451:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788636261.446482:0:6657:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788636261.446905:0:6657:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788636261.446915:0:6657:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788636261.446925:0:6657:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa6aa59fb12fa705e 00000020:01000004:3.0:1788636261.446932:0:6657:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788636261.446952:0:6657:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.157@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788636261.446956:0:6657:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788636261.446961:0:6657:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788636261.446964:0:6657:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788636261.446977:0:6657:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cfd5d2099c0) 00000020:00000080:3.0:1788636261.446987:0:6657:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788636261.448461:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636261.448655:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788636261.448669:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788636261.455932:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636261.455943:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788636261.456417:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788636261.456423:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788636261.458040:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636261.458392:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788636261.458399:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1788636261.459048:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1788636261.459055:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788636261.481423:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636261.481630:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788636261.481637:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788636261.483942:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788636261.483971:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1788636261.484682:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788636261.484690:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1788636261.487621:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636261.488971:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1788636261.488979:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788636261.491260:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788636261.491273:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788636261.530321:0:6657:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636261.530522:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788636261.530529:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788636261.531690:0:6657:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788636261.531698:0:6657:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788636261.532287:0:6657:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788636261.532310:0:6657:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788636261.532316:0:6657:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.157@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788636261.547963:0:6657:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.157@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788636261.547999:0:6657:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.157@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788636261.548003:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788636261.548004:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788636261.548006:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636261.548007:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636261.548008:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636261.548010:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636261.548011:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636261.548012:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636261.548014:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636261.548015:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636261.548016:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788636261.548020:0:6657:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788636261.548022:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636261.548027:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788636261.548028:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636261.548030:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636261.548031:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636261.548032:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636261.548033:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636261.548034:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636261.548035:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636261.548036:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636261.548037:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788636261.548071:0:6657:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788636261.548111:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976327552:0@lo:253: 00000100:00100000:2.0:1788636261.548179:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.548387:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f4c1780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636261.548617:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976327552 00000100:00100000:3.0:1788636261.548631:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976327552 00000100:00100000:3.0:1788636261.548712:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788636261.548722:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976327552:12345-0@lo:253: 20000000:01000000:3.0:1788636261.548760:0:5805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788636261.548764:0:5805:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1788636261.548771:0:5805:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1788636261.548774:0:5805:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1788636261.550728:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636261.551102:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1788636261.551118:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1788636261.551172:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1788636261.551182:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1788636261.551289:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1788636261.551336:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1788636261.551693:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1788636261.551712:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.157@tcp 20000000:01000000:3.0:1788636261.551714:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.157@tcp (null) (null) (null) 00000040:00080000:3.0:1788636261.551746:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1788636261.551755:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788636261.552098:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1788636261.552107:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.157@tcp (null) (null) 00000040:00080000:3.0:1788636261.552142:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1788636261.552150:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788636261.552175:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1788636261.552291:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1788636261.553078:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1788636261.553109:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.157@tcp 20000000:01000000:3.0:1788636261.553111:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.157@tcp (null) (null) (null) 00000040:00080000:3.0:1788636261.553143:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1788636261.553149:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788636261.553173:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1788636261.553186:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.157@tcp (null) (null) 00000040:00080000:3.0:1788636261.553306:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1788636261.553316:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1788636261.553348:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1788636261.553382:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1788636261.553397:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1788636261.553399:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1788636261.553405:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788636261.553406:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788636261.553408:0:5805:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788636261.553420:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788636261.553423:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788636261.553454:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788636261.553456:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788636261.553996:0:6672:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1788636261.554315:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1788636261.554363:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1788636261.554425:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1788636261.554438:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788636261.554440:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788636261.554897:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788636261.554945:0:6673:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788636261.555001:0:6673:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1788636261.555287:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1788636261.555329:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1788636261.555382:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1788636261.555391:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788636261.555392:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788636261.555917:0:6674:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1788636261.555950:0:6674:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1788636261.555975:0:6674:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788636261.556262:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788636261.556287:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788636261.556305:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:2.0:1788636261.556321:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788636261.556340:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.556359:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd40030c00/0xa6aa59fb12fa6f85 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.556382:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa6fa1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.556388:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7011 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.556396:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.556434:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.556456:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 12 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.556470:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976327680:0@lo:104: 00000100:00100000:2.0:1788636261.556541:0:5805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636261.556580:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976327680 00000100:00100000:3.0:1788636261.556586:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976327680 00010000:00010000:2.0:1788636261.556619:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa6fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.556628:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788636261.556632:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa6fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 12 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.556643:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:5805:x1875520976327680:12345-0@lo:104: 00000100:00100000:2.0:1788636261.556646:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976327808:0@lo:104: 00000100:00100000:2.0:1788636261.556665:0:5805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636261.556674:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.556691:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd40030c00/0xa6aa59fb12fa6f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.556698:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd40030c00/0xa6aa59fb12fa6f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 12 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.556704:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976327936:0@lo:104: 00000100:00100000:2.0:1788636261.556724:0:5805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.556736:0:5805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f4c19c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788636261.556751:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636261.556751:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976327680:0@lo:104: 00000100:00100000:3.0:1788636261.556768:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:5805:x1875520976327680:12345-0@lo:104: Request processed in 124us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636261.556778:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788636261.556789:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636261.556819:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.556826:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40031000 already unused, calling callback (ffffffffc1de6c20) 00000100:00100000:3.0:1788636261.556827:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976327808 10000000:00010000:1.0:1788636261.556829:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa700a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.556832:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976327808 00010000:00010000:1.0:1788636261.556840:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa700a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636261.556846:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa700a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.556849:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976327936 00000100:00100000:3.0:1788636261.556852:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976327936 10000000:01000000:1.0:1788636261.556858:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788636261.556868:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636261.556876:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+4:5805:x1875520976327808:12345-0@lo:104: 00010000:00010000:3.0:1788636261.556885:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa6f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.556889:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa700a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.556898:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636261.556923:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa700a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.556930:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa700a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7011 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.556933:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788636261.556942:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+4:5805:x1875520976327808:12345-0@lo:104: Request processed in 67us (275us total) trans 0 rc 0/0 00010000:00010000:1.0:1788636261.556948:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1788636261.556951:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788636261.556953:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa6f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.556959:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636261.556961:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa6f9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.556966:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa6f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.556971:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 10000000:00010000:1.0:1788636261.556972:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa6f9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636261.556978:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788636261.556982:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:5805:x1875520976327936:12345-0@lo:104: 00010000:00010000:3.0:1788636261.556992:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c200/0xa6aa59fb12fa6f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.556995:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa6f9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.557005:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636261.557027:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788636261.557030:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa6f9a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.557036:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:5805:x1875520976327936:12345-0@lo:104: Request processed in 54us (309us total) trans 0 rc 0/0 00010000:00010000:1.0:1788636261.557042:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa6f9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6fa1 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.557047:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788636261.557061:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636261.557064:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c200/0xa6aa59fb12fa6f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557069:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636261.557071:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636261.557074:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c200/0xa6aa59fb12fa6f7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.557093:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c200/0xa6aa59fb12fa6f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636261.557100:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c200/0xa6aa59fb12fa6f7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636261.557106:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1788636261.557111:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976327808:0@lo:104: 00000100:00100000:3.0:1788636261.557123:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976327936:0@lo:104: 00010000:00010000:1.0:1788636261.557123:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c200/0xa6aa59fb12fa6f7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.557135:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636261.557144:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c200/0xa6aa59fb12fa6f7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557152:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.557153:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c200/0xa6aa59fb12fa6f7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa6f85 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.557332:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636261.557338:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636261.557340:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636261.557354:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976328064:0@lo:103: 00000100:00100000:1.0:1788636261.557432:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.557472:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976328064 00000100:00100000:2.0:1788636261.557476:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976328064 00000100:00100000:1.0:1788636261.557486:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976328192:0@lo:103: 00010000:00010000:2.0:1788636261.557493:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 13 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636261.557527:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.557621:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976328192 00000100:00100000:2.0:1788636261.557627:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976328192 00000100:00100000:3.0:1788636261.557633:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636261.557634:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636261.557642:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+14:3283:x1875520976328064:12345-0@lo:103: 00010000:00010000:2.0:1788636261.557642:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa6fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 14 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636261.557643:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976328320:0@lo:103: 00010000:00010000:3.0:1788636261.557658:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636261.557664:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7011 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 14 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.557670:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788636261.557671:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.557678:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1788636261.557683:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7011 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 14 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557698:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7011 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa700a expref: 14 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636261.557699:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788636261.557709:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976328320 00000100:00100000:1.0:1788636261.557713:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976328320 00010000:00010000:3.0:1788636261.557717:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636261.557729:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd40030c00/0xa6aa59fb12fa6f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 14 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636261.557743:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788636261.557748:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636261.557755:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+14:3280:x1875520976328192:12345-0@lo:103: 00000100:00100000:3.0:1788636261.557761:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+14:3283:x1875520976328064:12345-0@lo:103: Request processed in 120us (327us total) trans 0 rc 0/0 00010000:00010000:1.0:1788636261.557762:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636261.557768:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa6fa1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 14 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.557774:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788636261.557777:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa6fa1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 14 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.557786:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa6fa1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f9a expref: 13 pid: 5805 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.557811:0:5796:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1788636261.557820:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636261.557822:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636261.557830:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+12:3280:x1875520976328320:12345-0@lo:103: 00010000:00010000:3.0:1788636261.557841:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636261.557846:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd40030c00/0xa6aa59fb12fa6f85 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 12 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557858:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd40030c00/0xa6aa59fb12fa6f85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 12 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636261.557866:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+12:3280:x1875520976328192:12345-0@lo:103: Request processed in 110us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636261.557882:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636261.557882:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976328192:0@lo:103: 00010000:00010000:3.0:1788636261.557889:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40030c00/0xa6aa59fb12fa6f85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa6f7e expref: 12 pid: 5804 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557906:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557915:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636261.557918:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976328064:0@lo:103: 00010000:00010000:3.0:1788636261.557933:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557942:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557950:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557956:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557963:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636261.557967:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557974:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.557998:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.558017:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636261.558042:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+10:3280:x1875520976328320:12345-0@lo:103: Request processed in 214us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636261.558048:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1788636261.558105:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.558113:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.558125:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa706c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636261.558126:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976328320:0@lo:103: 20000000:01000000:1.0:1788636261.558143:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788636261.594907:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+9:6657:x1875520976327552:12345-0@lo:253: Request processed in 46178us (46718us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636261.594965:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636261.594996:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976327552:0@lo:253: 10000000:01000000:2.0:1788636261.595011:0:6657:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788636261.595014:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636261.595016:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788636261.595017:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636261.595019:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788636261.595020:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636261.595021:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636261.595023:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636261.595024:0:6657:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788636261.595026:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636261.595027:0:6657:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788636261.595054:0:6657:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cfd76a12000 from lustre-OST0000 10000000:01000000:2.0:1788636261.595077:0:6657:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788636261.595091:0:6657:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788636261.595098:0:6657:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cfd5d20cd40 local copy 10000000:01000000:2.0:1788636261.595102:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788636261.595143:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.595154:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.595163:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.595199:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976328448:0@lo:101: 00000100:00100000:2.0:1788636261.595235:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.595341:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636261.595524:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976328448 00000100:00100000:1.0:1788636261.595531:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976328448 00000100:00100000:1.0:1788636261.595569:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788636261.595583:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+9:6657:x1875520976328448:12345-0@lo:101: 00010000:00010000:1.0:1788636261.595593:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636261.595607:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167c400/0xa6aa59fb12fa707a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7073 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.595630:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167c400/0xa6aa59fb12fa707a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7073 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.595640:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167c400/0xa6aa59fb12fa707a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7073 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.595649:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167c400, rc 0) 00000100:00100000:1.0:1788636261.595692:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+10:6657:x1875520976328448:12345-0@lo:101: Request processed in 115us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636261.595705:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636261.595717:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976328448:0@lo:101: 00010000:00010000:2.0:1788636261.595730:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.595739:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.595846:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976328576:0@lo:501: 00000100:00100000:2.0:1788636261.595872:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.595906:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636261.595913:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976328576 00000100:00100000:3.0:1788636261.595918:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976328576 00000100:00100000:3.0:1788636261.595947:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788636261.595955:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+10:6657:x1875520976328576:12345-0@lo:501: 00000100:00100000:3.0:1788636261.596162:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+10:6657:x1875520976328576:12345-0@lo:501: Request processed in 207us (288us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636261.596169:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788636261.596189:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976328576:0@lo:501: 10000000:01000000:2.0:1788636261.596201:0:6657:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788636261.596226:0:6657:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788636261.596232:0:6657:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.596241:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.596248:0:6657:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.596312:0:6657:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788636261.596339:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cfd76a12000 10000000:01000000:2.0:1788636261.596343:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788636261.596347:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cfd5d20cd40 10000000:01000000:2.0:1788636261.596349:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788636261.596353:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cfd5d20cd40 from 1 10000000:01000000:2.0:1788636261.596355:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788636261.596386:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.596562:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.596572:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.596591:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976328704:0@lo:101: 00010000:00010000:0.0:1788636261.596593:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636261.596600:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636261.596607:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff600 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636261.596611:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.596626:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636261.596632:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636261.596639:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636261.596645:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788636261.596646:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131c240 going to sleep for 11 seconds 00010000:00010000:0.0:1788636261.596664:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636261.596670:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636261.596699:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636261.596706:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff600/0xa6aa59fb12fa7073 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6aa59fb12fa707a expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636261.596722:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636261.596724:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636261.596725:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636261.596754:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976328832:0@lo:103: 00000100:00100000:2.0:1788636261.596781:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636261.596884:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976328832 00000100:00100000:0.0:1788636261.596889:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976328832 00000100:00100000:0.0:1788636261.596919:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636261.596927:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+10:3282:x1875520976328832:12345-0@lo:103: 00010000:00010000:0.0:1788636261.596936:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636261.596947:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167c400/0xa6aa59fb12fa707a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa7073 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636261.596959:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636261.597008:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+9:3282:x1875520976328832:12345-0@lo:103: Request processed in 82us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636261.597015:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636261.597062:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976328832:0@lo:103: 00000100:00100000:1.0:1788636261.597128:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976328704 00000100:00100000:1.0:1788636261.597132:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976328704 00000100:00100000:1.0:1788636261.597159:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636261.597166:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+9:6657:x1875520976328704:12345-0@lo:101: 00010000:00010000:1.0:1788636261.597173:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636261.597183:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167d400/0xa6aa59fb12fa7088 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7081 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.597198:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167d400/0xa6aa59fb12fa7088 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7081 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.597207:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167d400/0xa6aa59fb12fa7088 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7081 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.597213:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167d400, rc 0) 00000100:00100000:1.0:1788636261.597291:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+10:6657:x1875520976328704:12345-0@lo:101: Request processed in 125us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636261.597297:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788636261.597601:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976328704:0@lo:101: 00010000:00010000:2.0:1788636261.597614:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7088 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.597622:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7088 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636261.597638:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788636261.597662:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7088 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.597669:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7088 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636261.597676:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788636261.597681:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636261.597686:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788636261.597689:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788636261.597703:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.597708:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.597712:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.597721:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976328960:0@lo:101: 00000100:00100000:2.0:1788636261.597752:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.597812:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788636261.597966:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976328960 00000100:00100000:3.0:1788636261.597971:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976328960 00000100:00100000:3.0:1788636261.598306:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788636261.598315:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+10:6657:x1875520976328960:12345-0@lo:101: 00010000:00010000:3.0:1788636261.598323:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636261.598335:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa708f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.598351:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.598360:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.598381:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997ca00, rc 0) 00000100:00100000:3.0:1788636261.598423:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976328960:12345-0@lo:101: Request processed in 110us (669us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636261.598429:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788636261.598496:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976328960:0@lo:101: 00010000:00010000:2.0:1788636261.598507:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.598515:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.598613:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329088:0@lo:501: 00000100:00100000:2.0:1788636261.598648:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.598879:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788636261.598960:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976329088 00000100:00100000:0.0:1788636261.598965:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976329088 00000100:00100000:0.0:1788636261.598988:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788636261.598995:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329088:12345-0@lo:501: 00000100:00100000:0.0:1788636261.599558:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329088:12345-0@lo:501: Request processed in 561us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636261.599566:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636261.599647:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329088:0@lo:501: 00000100:00100000:2.0:1788636261.599680:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329216:0@lo:503: 00000100:00100000:2.0:1788636261.599722:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.599755:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788636261.599814:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976329216 00000100:00100000:3.0:1788636261.599820:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976329216 00000100:00100000:3.0:1788636261.600061:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788636261.600070:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329216:12345-0@lo:503: 00000100:00100000:3.0:1788636261.600246:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329216:12345-0@lo:503: Request processed in 177us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636261.600253:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636261.600371:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329216:0@lo:503: 00000040:00080000:2.0:1788636261.601135:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636261.601198:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329344:0@lo:502: 00000100:00100000:2.0:1788636261.601244:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.601267:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636261.601343:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976329344 00000100:00100000:1.0:1788636261.601348:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976329344 00000100:00100000:1.0:1788636261.601386:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788636261.601395:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329344:12345-0@lo:502: 00000100:00100000:1.0:1788636261.601554:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329344:12345-0@lo:502: Request processed in 160us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636261.601561:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636261.602127:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329344:0@lo:502: 00000040:00080000:2.0:1788636261.602378:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788636261.602428:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788636261.602463:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788636261.602522:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788636261.602563:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788636261.602768:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788636261.602849:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329472:0@lo:502: 00000100:00100000:2.0:1788636261.602898:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.602940:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788636261.603291:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976329472 00000100:00100000:0.0:1788636261.603297:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976329472 00000100:00100000:0.0:1788636261.603343:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788636261.603353:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329472:12345-0@lo:502: 00000100:00100000:0.0:1788636261.603528:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329472:12345-0@lo:502: Request processed in 176us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636261.603535:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788636261.603567:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329472:0@lo:502: 00000040:00080000:2.0:1788636261.603670:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788636261.603680:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788636261.604370:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788636261.604377:0:6676:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788636261.604390:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636261.604392:0:6676:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788636261.604397:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788636261.604410:0:6676:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cfd48dc8000) 00000020:00000080:2.0:1788636261.604429:0:6676:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788636261.604435:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788636261.604488:0:6676:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd76a12000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788636261.604494:0:6676:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788636261.604500:0:6676:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa6aa59fb12fa70a4 00010000:00010000:3.0:1788636261.611778:0:6676:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788636261.612229:0:6676:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788636261.615174:0:6676:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788636261.615469:0:6676:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788636261.624244:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788636261.624772:0:6676:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1788636261.626837:0:6676:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788636261.626847:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636261.626853:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636261.626856:0:6676:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788636261.626859:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636261.626863:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636261.626864:0:6676:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788636261.626867:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788636261.626868:0:6676:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788636261.626914:0:6676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636261.626917:0:6676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636261.626919:0:6676:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788636261.626922:0:6676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1788636261.627264:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1788636261.627291:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788636261.627312:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.627324:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636261.627340:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd76a12000 from 1 10000000:01000000:2.0:1788636261.627343:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636261.627376:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.627384:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.627403:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.627426:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329600:0@lo:101: 00000100:00100000:2.0:1788636261.627484:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.627691:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131cd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636261.632552:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976329600 00000100:00100000:2.0:1788636261.632564:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976329600 00000100:00100000:2.0:1788636261.632647:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636261.632658:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:6657:x1875520976329600:12345-0@lo:101: 00010000:00010000:2.0:1788636261.632674:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636261.632692:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa70ab expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.632718:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.632730:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.632740:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ff800, rc 0) 00000100:00100000:2.0:1788636261.633639:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976329600:12345-0@lo:101: Request processed in 980us (6152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636261.633649:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788636261.636021:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329600:0@lo:101: 00010000:00010000:3.0:1788636261.636047:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.636060:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.636392:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329728:0@lo:501: 00000100:00100000:3.0:1788636261.636512:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636261.636570:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd79f68240 going to sleep for 11 seconds 00000100:00100000:2.0:1788636261.636642:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976329728 00000100:00100000:2.0:1788636261.636648:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976329728 00000100:00100000:2.0:1788636261.636692:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788636261.636702:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976329728:12345-0@lo:501: 00000100:00100000:2.0:1788636261.636952:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976329728:12345-0@lo:501: Request processed in 250us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636261.636960:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636261.637100:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329728:0@lo:501: 00000100:00100000:3.0:1788636261.637129:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329856:0@lo:503: 00000100:00100000:3.0:1788636261.637178:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636261.637314:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd79f68240 going to sleep for 11 seconds 00000100:00100000:2.0:1788636261.637494:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976329856 00000100:00100000:2.0:1788636261.637499:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976329856 00000100:00100000:2.0:1788636261.637569:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788636261.637576:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976329856:12345-0@lo:503: 00000100:00100000:2.0:1788636261.637762:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976329856:12345-0@lo:503: Request processed in 186us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636261.637769:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788636261.638774:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329856:0@lo:503: 00000040:00080000:2.0:1788636261.639487:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636261.639561:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329984:0@lo:502: 00000100:00100000:2.0:1788636261.639614:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.639685:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7faf1f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636261.639731:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976329984 00000100:00100000:1.0:1788636261.639736:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976329984 00000100:00100000:1.0:1788636261.639891:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636261.639899:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976329984:12345-0@lo:502: 00000100:00100000:1.0:1788636261.640064:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976329984:12345-0@lo:502: Request processed in 165us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636261.640071:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788636261.640153:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976329984:0@lo:502: 00000040:00080000:2.0:1788636261.640439:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788636261.640485:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788636261.640508:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330112:0@lo:502: 00000100:00100000:2.0:1788636261.640543:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.640976:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7faf1f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788636261.641497:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976330112 00000100:00100000:3.0:1788636261.641503:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976330112 00000100:00100000:3.0:1788636261.641533:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636261.641540:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976330112:12345-0@lo:502: 00000100:00100000:3.0:1788636261.641697:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976330112:12345-0@lo:502: Request processed in 156us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636261.641704:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788636261.641813:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330112:0@lo:502: 00000040:00080000:2.0:1788636261.641902:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788636261.641912:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788636261.642668:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636261.642677:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636261.642679:0:6680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788636261.642685:0:6680:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd76a12000 00000020:00000080:2.0:1788636261.642687:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636261.642705:0:6680:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636261.642708:0:6680:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636261.642709:0:6680:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788636261.642712:0:6680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788636261.642932:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788636261.642951:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636261.642996:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.643008:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636261.643045:0:6657:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788636261.643048:0:6657:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cfd76a12000 10000000:01000000:3.0:1788636261.643051:0:6657:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cfd76a12000 10000000:01000000:3.0:1788636261.643055:0:6657:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788636261.643059:0:6657:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd76a12000 from 1 10000000:01000000:3.0:1788636261.643062:0:6657:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788636261.643097:0:6657:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.643117:0:6657:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.643126:0:6657:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.643145:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d297100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330240:0@lo:101: 00000100:00100000:3.0:1788636261.643295:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.643465:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976330240 00000100:00100000:2.0:1788636261.643476:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976330240 00000100:00100000:2.0:1788636261.643516:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788636261.643525:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976330240:12345-0@lo:101: 00010000:00010000:2.0:1788636261.643535:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636261.643548:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa70b9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.643570:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.643580:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.643588:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe400, rc 0) 00000100:00100000:2.0:1788636261.643618:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330240:12345-0@lo:101: Request processed in 94us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636261.643623:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788636261.643695:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd79f68300 going to sleep for 11 seconds 00000100:00100000:3.0:1788636261.643712:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d297100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330240:0@lo:101: 00010000:00010000:3.0:1788636261.643724:0:6657:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636261.643733:0:6657:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.643868:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d297100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330368:0@lo:501: 00000100:00100000:3.0:1788636261.643894:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636261.643917:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd79f68300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636261.643984:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976330368 00000100:00100000:2.0:1788636261.643988:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976330368 00000100:00100000:2.0:1788636261.644008:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788636261.644014:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330368:12345-0@lo:501: 00000100:00100000:2.0:1788636261.644594:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330368:12345-0@lo:501: Request processed in 579us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636261.644602:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788636261.644651:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d297100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330368:0@lo:501: 00000100:00100000:3.0:1788636261.644677:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d297100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330496:0@lo:503: 00000100:00100000:3.0:1788636261.644713:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636261.644771:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd79f68300 going to sleep for 11 seconds 00000100:00100000:1.0:1788636261.644933:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976330496 00000100:00100000:1.0:1788636261.644938:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976330496 00000100:00100000:1.0:1788636261.645287:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788636261.645297:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330496:12345-0@lo:503: 00000100:00100000:1.0:1788636261.645612:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330496:12345-0@lo:503: Request processed in 316us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636261.645619:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788636261.645670:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d297100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330496:0@lo:503: 00000040:00080000:2.0:1788636261.645932:0:6657:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636261.645985:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330624:0@lo:502: 00000100:00100000:2.0:1788636261.646020:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.646178:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7faf1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636261.646282:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976330624 00000100:00100000:3.0:1788636261.646287:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976330624 00000100:00100000:3.0:1788636261.646310:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636261.646322:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330624:12345-0@lo:502: 00000100:00100000:3.0:1788636261.646646:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330624:12345-0@lo:502: Request processed in 323us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636261.646653:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788636261.646731:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330624:0@lo:502: 00000040:00080000:2.0:1788636261.647004:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788636261.647049:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788636261.647093:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788636261.647149:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788636261.647298:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788636261.647480:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788636261.647520:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788636261.647552:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788636261.647614:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788636261.647650:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788636261.647685:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788636261.647731:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788636261.647765:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788636261.647815:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788636261.647879:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788636261.647914:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788636261.647948:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788636261.648009:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788636261.648049:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788636261.648096:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788636261.648143:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788636261.648308:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788636261.648552:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788636261.648603:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788636261.648652:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1788636261.648684:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1788636261.648730:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1788636261.648764:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1788636261.651296:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330752:0@lo:502: 00000100:00100000:2.0:1788636261.651535:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636261.651590:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976330752 00000100:00100000:2.0:1788636261.651592:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7faf1840 going to sleep for 11 seconds 00000100:00100000:0.0:1788636261.651598:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976330752 00000100:00100000:0.0:1788636261.651646:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788636261.651656:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330752:12345-0@lo:502: 00000100:00100000:0.0:1788636261.652056:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976330752:12345-0@lo:502: Request processed in 400us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636261.652065:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788636261.652294:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976330752:0@lo:502: 00000040:00080000:2.0:1788636261.652523:0:6657:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1788636261.652538:0:6657:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788636261.653142:0:6681:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788636261.653264:0:6681:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cfd7a543380) 00000020:00000080:0.0:1788636261.653285:0:6681:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788636261.653490:0:6681:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd76a12000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788636261.653495:0:6681:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd76a12000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788636261.653497:0:6681:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd76a12000 3 00010000:00080000:0.0:1788636261.653532:0:6681:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd7fd0c000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.157@tcp at head 00010000:00010000:0.0:1788636261.657314:0:6681:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788636261.657654:0:6681:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788636261.657688:0:6681:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788636261.657700:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa6aa59fb12fa70ce 00000100:00080000:0.0:1788636261.657710:0:6681:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636261.657716:0:6681:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cfd7fd0c000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:0.0:1788636261.657748:0:6681:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd756a4700 x1875520976330880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636261.657776:0:6681:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788636261.657975:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1875520976330880:0@lo:38: 00000100:00100000:2.0:1788636261.658056:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636261.658171:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976330880 00000100:00100000:0.0:1788636261.658178:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976330880 00000100:00100000:0.0:1788636261.658276:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636261.658283:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1875520976330880:12345-0@lo:38: 00010000:00080000:0.0:1788636261.658305:0:5812:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 130 last 0 00000020:00000080:0.0:1788636261.658392:0:5812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa6aa59fb12fa70d5 00000004:00100000:0.0:1788636261.658441:0:5812:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788636261.658463:0:5812:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fd08000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636261.658501:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875520976330880:12345-0@lo:38: Request processed in 217us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636261.658506:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788636261.658754:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cfd756a4700 x1875520976330880/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636271 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636261.658764:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636261.658771:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788636261.658782:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788636261.658786:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788636261.658788:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fd0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788636261.659388:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1875520976330880:0@lo:38: 00000040:00080000:3.0:1788636261.659584:0:6681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1788636261.660006:0:6657:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1788636261.660029:0:6657:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788636261.660046:0:6657:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.660057:0:6657:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788636261.660113:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788636261.660115:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788636261.660117:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636261.660118:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636261.660119:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636261.660121:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636261.660122:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636261.660127:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636261.660129:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636261.660130:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636261.660131:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636261.660135:0:6657:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788636261.660137:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788636261.660138:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788636261.660139:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636261.660140:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636261.660141:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636261.660142:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636261.660143:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636261.660144:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788636261.660145:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788636261.660146:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636261.660147:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788636261.660164:0:6657:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788636261.660177:0:6657:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a283100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976331008:0@lo:253: 00000100:00100000:2.0:1788636261.661386:0:6657:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.661492:0:6657:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7faf1840 going to sleep for 11 seconds 00000100:00100000:3.0:1788636261.661575:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976331008 00000100:00100000:3.0:1788636261.661582:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976331008 00000100:00100000:3.0:1788636261.661633:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788636261.661643:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:6657:x1875520976331008:12345-0@lo:253: 20000000:01000000:3.0:1788636261.661668:0:5805:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788636261.661680:0:5805:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788636261.682165:0:5805:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788636261.682178:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1788636261.682206:0:5826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788636261.682210:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788636261.682230:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.682248:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa703b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.682256:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.682294:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.682336:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa703b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 13 pid: 5803 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.682350:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1875520976331136:0@lo:104: 00000100:00100000:2.0:1788636261.682418:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.682467:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7faf1f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636261.682487:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976331136 00000100:00100000:2.0:1788636261.682493:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976331136 00000100:00100000:2.0:1788636261.682532:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636261.682541:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:5826:x1875520976331136:12345-0@lo:104: 00010000:00010000:2.0:1788636261.682555:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd40031200/0xa6aa59fb12fa7034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.682612:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636261.682619:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:5826:x1875520976331136:12345-0@lo:104: Request processed in 79us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636261.682626:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636261.682662:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1875520976331136:0@lo:104: 00010000:00010000:2.0:1788636261.682678:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.682830:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636261.682837:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd40031200/0xa6aa59fb12fa7034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.682845:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40031200 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636261.682849:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031200/0xa6aa59fb12fa7034 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.682857:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd40031200/0xa6aa59fb12fa7034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636261.682863:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031200/0xa6aa59fb12fa7034 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636261.682869:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636261.683054:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd40031200/0xa6aa59fb12fa7034 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.683072:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636261.683106:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd40031200/0xa6aa59fb12fa7034 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636261.683110:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976331264:0@lo:103: 00010000:00010000:1.0:1788636261.683113:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd40031200/0xa6aa59fb12fa7034 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa703b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636261.683128:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636261.683130:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636261.683132:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636261.683143:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636261.683580:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976331264 00000100:00100000:2.0:1788636261.683586:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976331264 00010000:00010000:2.0:1788636261.683731:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa703b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 14 pid: 5803 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.683762:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636261.683769:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+14:3283:x1875520976331264:12345-0@lo:103: 00010000:00010000:2.0:1788636261.683814:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636261.683828:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa703b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 14 pid: 5803 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683839:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa703b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 14 pid: 5803 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683853:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa703b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7034 expref: 14 pid: 5803 timeout: 280 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683866:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683873:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788636261.683894:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004805342s 00010000:00010000:2.0:1788636261.683899:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683906:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683912:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683918:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683924:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffc00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636261.683928:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683941:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683957:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636261.683967:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636261.683996:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.684002:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699ab450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+13:3283:x1875520976331264:12345-0@lo:103: Request processed in 234us (858us total) trans 0 rc 0/0 00010000:00010000:3.0:1788636261.684005:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.684009:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1788636261.684011:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa70dc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636261.684060:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976331264:0@lo:103: 00000100:00100000:2.0:1788636261.688915:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:6657:x1875520976331008:12345-0@lo:253: Request processed in 27257us (27575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636261.688929:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636261.688965:0:6657:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a283100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:6657:1875520976331008:0@lo:253: 10000000:01000000:0.0:1788636261.688980:0:6657:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788636261.688984:0:6657:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788636261.688985:0:6657:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788636261.688987:0:6657:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636261.688988:0:6657:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636261.688989:0:6657:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636261.688991:0:6657:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636261.688992:0:6657:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788636261.688993:0:6657:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788636261.688994:0:6657:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788636261.688996:0:6657:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636261.688997:0:6657:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788636261.689010:0:6657:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788636261.693751:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788636261.694129:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788636261.694337:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788636261.694542:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788636261.694732:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788636261.694962:0:6657:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788636261.696315:0:6657:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788636261.919035:0:6657:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788636261.919042:0:6657:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788636261.919073:0:6657:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788636261.920338:0:6657:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788636261.920358:0:6657:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788636261.920390:0:6657:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788636261.950869:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636262.979095:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636264.000448:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636265.022983:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636266.046922:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788636266.624363:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788636266.624382:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd613a5000 from 21 10000000:01000000:0.0:1788636266.624387:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788636266.624431:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.624442:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.624453:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636266.624474:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976331392:0@lo:101: 00000100:00100000:0.0:1788636266.624537:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636266.624594:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636266.624609:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976331392 00000100:00100000:1.0:1788636266.624618:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976331392 00000100:00100000:1.0:1788636266.624675:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788636266.624685:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976331392:12345-0@lo:101: 00010000:00010000:1.0:1788636266.624697:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636266.624711:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa70e3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.624735:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.624746:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.624756:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167c000, rc 0) 00000100:00100000:1.0:1788636266.624819:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976331392:12345-0@lo:101: Request processed in 136us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636266.624825:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788636266.625955:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976331392:0@lo:101: 00010000:00010000:0.0:1788636266.625975:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.625986:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636266.626043:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976331520:0@lo:501: 00000100:00100000:0.0:1788636266.626953:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636266.626989:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636266.627087:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976331520 00000100:00100000:2.0:1788636266.627094:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976331520 00000100:00100000:2.0:1788636266.627130:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788636266.627140:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976331520:12345-0@lo:501: 00000100:00100000:2.0:1788636266.627494:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976331520:12345-0@lo:501: Request processed in 355us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636266.627502:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636266.627642:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976331520:0@lo:501: 00000100:00100000:0.0:1788636266.627676:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976331648:0@lo:503: 00000100:00100000:0.0:1788636266.627713:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636266.627739:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636266.628252:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976331648 00000100:00100000:2.0:1788636266.628258:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976331648 00000100:00100000:2.0:1788636266.628290:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788636266.628297:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976331648:12345-0@lo:503: 00000100:00100000:2.0:1788636266.629694:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976331648:12345-0@lo:503: Request processed in 1393us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636266.629704:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788636266.630387:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976331648:0@lo:503: 00000100:00100000:1.0:1788636266.630671:0:6950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6950:1875520976331776:0@lo:502: 00000100:00100000:1.0:1788636266.630720:0:6950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636266.630755:0:6950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd73b020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636266.630931:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976331776 00000100:00100000:0.0:1788636266.630937:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976331776 00000100:00100000:0.0:1788636266.630983:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636266.630992:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:6950:x1875520976331776:12345-0@lo:502: 00000100:00100000:0.0:1788636266.631316:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:6950:x1875520976331776:12345-0@lo:502: Request processed in 325us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636266.631324:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788636266.631394:0:6950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6950:1875520976331776:0@lo:502: 00000100:00100000:1.0:1788636266.631439:0:6950:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6950:1875520976331904:0@lo:502: 00000100:00100000:1.0:1788636266.631470:0:6950:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636266.631497:0:6950:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd73b020c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636266.631532:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976331904 00000100:00100000:0.0:1788636266.631536:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976331904 00000100:00100000:0.0:1788636266.631563:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636266.631570:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:6950:x1875520976331904:12345-0@lo:502: 00000100:00100000:0.0:1788636266.631691:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:6950:x1875520976331904:12345-0@lo:502: Request processed in 122us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636266.631698:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788636266.631759:0:6950:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6950:1875520976331904:0@lo:502: 00000040:00080000:1.0:1788636266.631777:0:6950:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1788636266.631927:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1788636266.631942:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788636266.631951:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.631962:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636266.631970:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788636266.631973:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cfd613a5000 from 4 10000000:01000000:0.0:1788636266.631975:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788636266.631998:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.632006:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.632020:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636266.632031:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332032:0@lo:101: 00000100:00100000:0.0:1788636266.632067:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636266.632113:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09ec00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636266.632971:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976332032 00000100:00100000:1.0:1788636266.632979:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976332032 00000100:00100000:1.0:1788636266.633021:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788636266.633030:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976332032:12345-0@lo:101: 00010000:00010000:1.0:1788636266.633040:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636266.633064:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa70f1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.633086:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.633096:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.633105:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167de00, rc 0) 00000100:00100000:1.0:1788636266.633145:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976332032:12345-0@lo:101: Request processed in 118us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636266.633152:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788636266.633321:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332032:0@lo:101: 00010000:00010000:2.0:1788636266.633338:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636266.633349:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636266.633398:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332160:0@lo:256: 00000100:00100000:2.0:1788636266.633433:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636266.633460:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c9000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636266.633472:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976332160 00000100:00100000:1.0:1788636266.633477:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976332160 00000100:00100000:1.0:1788636266.633536:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788636266.633544:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976332160:12345-0@lo:256: 20000000:01000000:1.0:1788636266.633557:0:5804:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788636266.633571:0:5804:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788636266.633574:0:5804:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788636266.633645:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976332160:12345-0@lo:256: Request processed in 102us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636266.633652:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788636266.633714:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332160:0@lo:256: 10000000:01000000:2.0:1788636266.633753:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788636266.633760:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636266.633768:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636266.633776:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788636266.633779:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788636266.633782:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788636266.635133:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636266.635148:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636266.635169:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636266.635188:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332288:0@lo:101: 00000100:00100000:2.0:1788636266.635231:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636266.635267:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c9000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636266.636166:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976332288 00000100:00100000:0.0:1788636266.636174:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976332288 00000100:00100000:0.0:1788636266.636215:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636266.636224:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976332288:12345-0@lo:101: 00010000:00010000:0.0:1788636266.636236:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636266.636251:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa70ff expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.636275:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.636286:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.636295:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031c00, rc 0) 00000100:00100000:0.0:1788636266.636341:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976332288:12345-0@lo:101: Request processed in 118us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636266.636347:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636266.636388:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332288:0@lo:101: 00010000:00010000:0.0:1788636266.636402:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636266.636423:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636266.636474:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332416:0@lo:501: 00000100:00100000:0.0:1788636266.636498:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636266.636524:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636266.636536:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976332416 00000100:00100000:0.0:1788636266.636539:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976332416 00000100:00100000:0.0:1788636266.636574:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788636266.636580:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976332416:12345-0@lo:501: 00000100:00100000:0.0:1788636266.636815:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976332416:12345-0@lo:501: Request processed in 216us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636266.636823:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788636266.638286:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332416:0@lo:501: 00000100:00100000:3.0:1788636266.638335:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332544:0@lo:503: 00000100:00100000:3.0:1788636266.638396:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636266.638432:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5a4976c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636266.638458:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976332544 00000100:00100000:3.0:1788636266.638463:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976332544 00000100:00100000:3.0:1788636266.638507:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788636266.638516:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976332544:12345-0@lo:503: 00000100:00100000:3.0:1788636266.639652:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976332544:12345-0@lo:503: Request processed in 1134us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636266.639663:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788636266.640287:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976332544:0@lo:503: 00000100:00100000:1.0:1788636266.641599:0:6955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6955:1875520976332672:0@lo:502: 00000100:00100000:1.0:1788636266.641653:0:6955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636266.641691:0:6955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd50bd76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636266.642094:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976332672 00000100:00100000:1.0:1788636266.642100:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976332672 00000100:00100000:1.0:1788636266.642137:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636266.642145:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:6955:x1875520976332672:12345-0@lo:502: 00000100:00100000:1.0:1788636266.642431:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:6955:x1875520976332672:12345-0@lo:502: Request processed in 286us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636266.642438:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636266.642488:0:6955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6955:1875520976332672:0@lo:502: 00000020:01000000:1.0:1788636266.642513:0:6955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636266.642521:0:6955:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788636266.642528:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636266.642530:0:6955:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788636266.642536:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788636266.642540:0:6955:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.157@tcp to nid 0x20000c0a8cb9d (192.168.203.157@tcp) 00000020:01000000:1.0:1788636266.642575:0:6955:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788636266.642586:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636266.642600:0:6955:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cfd76a53380) 00000020:00000080:1.0:1788636266.642621:0:6955:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788636266.642628:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788636266.642703:0:6955:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788636266.642708:0:6955:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788636266.642715:0:6955:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa7114 00010000:00080000:1.0:1788636266.642741:0:6955:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd7a191800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.157@tcp at head 00010000:00010000:1.0:1788636266.642964:0:6955:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:1.0:1788636266.703358:0:6955:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1788636266.703379:0:6955:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788636266.703933:0:6955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636266.704121:0:6955:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636266.704186:0:6955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:1.0:1788636266.704245:0:6955:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1788636266.704904:0:6961:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636266.704908:0:6961:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788636266.705789:0:6955:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636266.705904:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788636266.706060:0:6955:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788636266.706082:0:6955:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa711b 00000100:00080000:3.0:1788636266.706092:0:6955:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636266.706099:0:6955:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cfd7a191800 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636266.706134:0:6955:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd5d295180 x1875520976332800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636266.706179:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976332800:0@lo:8: 00000100:00100000:2.0:1788636266.706249:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788636266.706289:0:6955:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788636266.706343:0:6955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636266.706348:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636266.706350:0:6955:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788636266.706353:0:6955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636266.706357:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636266.706358:0:6955:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788636266.706361:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788636266.706363:0:6955:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788636266.706384:0:6955:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6955:1875520976332928:0@lo:502: 00000100:00100000:2.0:1788636266.706435:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976332800 00000100:00100000:2.0:1788636266.706442:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976332800 00000100:00100000:2.0:1788636266.706591:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636266.706597:0:6661:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788636266.706598:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1875520976332800:12345-0@lo:8: 00000100:00100000:0.0:1788636266.706603:0:6661:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:2.0:1788636266.706620:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 135 last 0 00000020:00000080:2.0:1788636266.706644:0:6659:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa7122 00000100:00100000:3.0:1788636266.706766:0:6955:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636266.707027:0:6955:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5a497e40 going to sleep for 11 seconds 00002000:00100000:2.0:1788636266.707183:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cfd7fcf4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788636266.707188:0:6659:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788636266.707192:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788636266.707328:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976332928 00000100:00100000:0.0:1788636266.707330:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976333056:0@lo:400: 00000100:00100000:3.0:1788636266.707332:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976332928 00000100:00100000:0.0:1788636266.707363:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636266.707367:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788636266.707373:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:6955:x1875520976332928:12345-0@lo:502: 00000100:00100000:0.0:1788636266.707383:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636266.707388:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976333184:0@lo:400: 00000100:00100000:0.0:1788636266.707411:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636266.707436:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976333056 00000100:00100000:0.0:1788636266.707440:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976333056 00000100:00100000:0.0:1788636266.707464:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976333184 00000100:00100000:0.0:1788636266.707467:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976333184 00000100:00100000:0.0:1788636266.707488:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636266.707494:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976333056:12345-0@lo:400: 00000100:00100000:0.0:1788636266.707533:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976333056:12345-0@lo:400: Request processed in 39us (169us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636266.707545:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636266.707562:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636266.707563:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:6955:x1875520976332928:12345-0@lo:502: Request processed in 190us (797us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636266.707568:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976333184:12345-0@lo:400: 00000100:00100000:3.0:1788636266.707570:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788636266.707593:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976333184:12345-0@lo:400: Request processed in 26us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636266.707599:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636266.707615:0:6955:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:6955:1875520976332928:0@lo:502: 00010000:00080000:0.0:1788636266.707622:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d296680 x1875520976333184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636266.707632:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976333184:0@lo:400: 00000020:01000000:3.0:1788636266.707637:0:6955:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00010000:00080000:0.0:1788636266.707640:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d296a00 x1875520976333056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1788636266.707642:0:6955:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636266.707643:0:6955:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788636266.707647:0:6955:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00100000:0.0:1788636266.707648:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976333056:0@lo:400: 00000100:00080000:1.0:1788636266.707743:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:1.0:1788636266.707752:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:1.0:1788636266.707768:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788636266.707778:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.707788:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636266.707816:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788636266.707819:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cfd5d20cd40 from 1 10000000:01000000:1.0:1788636266.707821:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788636266.707844:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.707852:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.707867:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636266.707880:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976333312:0@lo:101: 00000100:00100000:1.0:1788636266.707910:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636266.707933:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4b40 going to sleep for 11 seconds 00002000:00100000:2.0:1788636266.708088:0:6659:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788636266.708252:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788636266.708276:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fcf4000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636266.708316:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875520976332800:12345-0@lo:8: Request processed in 1717us (2067us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636266.708324:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788636266.708689:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d295180 x1875520976332800/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636276 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636266.708699:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636266.708706:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00100000:3.0:1788636266.708889:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976333312 00000100:00100000:3.0:1788636266.708895:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976333312 00000100:00080000:2.0:1788636266.709071:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788636266.709077:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788636266.709080:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd7a191800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788636266.709092:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788636266.709097:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976332800:0@lo:8: 00000100:00100000:3.0:1788636266.709161:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636266.709169:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976333312:12345-0@lo:101: 00010000:00010000:3.0:1788636266.709178:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636266.709193:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7129 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636266.709215:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636266.709226:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636266.709235:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c400, rc 0) 00000100:00100000:3.0:1788636266.709933:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976333312:12345-0@lo:101: Request processed in 763us (2020us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636266.709940:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788636266.710386:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976333312:0@lo:101: 00010000:00010000:1.0:1788636266.710404:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.710416:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636266.710475:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976333440:0@lo:501: 00000100:00100000:1.0:1788636266.710506:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636266.710540:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636266.710919:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976333440 00000100:00100000:3.0:1788636266.710931:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976333440 00000100:00100000:3.0:1788636266.710971:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636266.710980:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976333440:12345-0@lo:501: 00000100:00100000:3.0:1788636266.711166:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976333440:12345-0@lo:501: Request processed in 186us (658us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636266.711174:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788636266.712097:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976333440:0@lo:501: 10000000:01000000:1.0:1788636266.712129:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788636266.712138:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636266.712148:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636266.714031:0:6961:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788636266.714310:0:6961:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 135738513600ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788636266.742659:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976333568:0@lo:13: 00000100:00100000:2.0:1788636266.742725:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636266.742826:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976333568 00000100:00100000:3.0:1788636266.742834:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976333568 00000100:00100000:3.0:1788636266.742891:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636266.742901:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976333568:12345-0@lo:13: 00002000:00000024:3.0:1788636266.742935:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000004:00080000:0.0:1788636266.743003:0:6962:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1788636266.743026:0:6962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875520976333696:0@lo:7: 00000100:00100000:0.0:1788636266.743068:0:6962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636266.743090:0:6962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636266.743132:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976333696 00000100:00100000:0.0:1788636266.743135:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976333696 00000100:00100000:0.0:1788636266.743170:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636266.743177:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6962:x1875520976333696:12345-0@lo:7: 00000100:00080000:1.0:1788636266.743737:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636266.748030:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976333568:12345-0@lo:13: Request processed in 5124us (5298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636266.748054:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00002000:00080000:0.0:1788636266.751739:0:6662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:0.0:1788636266.751749:0:6662:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788636266.751847:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6962:x1875520976333696:12345-0@lo:7: Request processed in 8667us (8777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636266.751857:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788636266.751963:0:6962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a7480 x1875520976333696/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788636282 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636266.751977:0:6962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875520976333696:0@lo:7: 00000004:00080000:0.0:1788636266.751990:0:6962:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1788636266.752027:0:6962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875520976333824:0@lo:5: 00000100:00100000:0.0:1788636266.752072:0:6962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636266.752121:0:6962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636266.752142:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976333824 00000100:00100000:0.0:1788636266.752147:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976333824 00000100:00100000:0.0:1788636266.754322:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636266.754334:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6962:x1875520976333824:12345-0@lo:5: 00002000:00080000:0.0:1788636266.754361:0:6662:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788636266.754365:0:6662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1788636266.754661:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6962:x1875520976333824:12345-0@lo:5: Request processed in 327us (2586us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1788636266.754669:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788636266.754711:0:6962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a7480 x1875520976333824/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636282 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636266.754727:0:6962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875520976333824:0@lo:5: 00000004:00080000:0.0:1788636266.754738:0:6962:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00010000:00080000:2.0:1788636266.754821:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a5c00 x1875520976333568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636282 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636266.754837:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976333568:0@lo:13: 00000004:00080000:0.0:1788636266.790326:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788636267.077240:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788636267.219782:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788636267.219818:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:02000400:1.0:1788636267.986292:0:7031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788636268.099009:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636269.126587:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636270.143103:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636271.167036:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636271.743694:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976333952:0@lo:400: 00000100:00100000:0.0:1788636271.743774:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636271.743863:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636271.743870:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976334336:0@lo:400: 00000100:00100000:0.0:1788636271.743897:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636271.743932:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976334080:0@lo:400: 00000100:00100000:0.0:1788636271.743957:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636271.743975:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636271.743980:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976334208:0@lo:400: 00000100:00100000:0.0:1788636271.744000:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636271.744039:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976333952 00000100:00100000:0.0:1788636271.744045:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976333952 00000100:00100000:0.0:1788636271.744087:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788636271.744096:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+16:3283:x1875520976333952:12345-0@lo:400: 00000100:00100000:0.0:1788636271.744142:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+16:3283:x1875520976333952:12345-0@lo:400: Request processed in 46us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636271.744149:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788636271.744180:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976334336 00000100:00100000:0.0:1788636271.744184:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976334336 00000100:00100000:0.0:1788636271.744219:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636271.744226:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976334336:12345-0@lo:400: 00000100:00100000:0.0:1788636271.744272:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976334336:12345-0@lo:400: Request processed in 46us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636271.744278:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636271.744295:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976334080 00000100:00100000:0.0:1788636271.744299:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976334080 00000100:00100000:0.0:1788636271.744321:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976334208 00000100:00100000:0.0:1788636271.744324:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976334208 00000100:00100000:0.0:1788636271.744340:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636271.744346:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976334080:12345-0@lo:400: 00000100:00100000:0.0:1788636271.744387:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976334080:12345-0@lo:400: Request processed in 41us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636271.744394:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636271.744406:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788636271.744412:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976334208:12345-0@lo:400: 00000100:00100000:0.0:1788636271.744436:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976334208:12345-0@lo:400: Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636271.744441:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1788636271.744461:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636271.744466:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636271.744494:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a4700 x1875520976334208/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636271.744507:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976334208:0@lo:400: 00010000:00080000:0.0:1788636271.744516:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a4000 x1875520976334080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636271.744524:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976334080:0@lo:400: 00010000:00080000:0.0:1788636271.744549:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a5f80 x1875520976334336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636271.744555:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788636271.744564:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976334336:0@lo:400: 00000100:00100000:0.0:1788636271.744571:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976333952:0@lo:400: 00010000:00010000:0.0:1788636272.191477:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636272.259171:0:6962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875520976334592:0@lo:700: 00000100:00100000:0.0:1788636272.259236:0:6962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636272.259306:0:6962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc4108a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636272.259412:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636272.259426:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976334464:0@lo:13: 00000100:00100000:1.0:1788636272.259461:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636272.260004:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976334464 00000100:00100000:0.0:1788636272.260022:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976334464 00000100:00100000:0.0:1788636272.260084:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636272.260094:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976334464:12345-0@lo:13: 00002000:00000024:0.0:1788636272.260140:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636272.260231:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976334464:12345-0@lo:13: Request processed in 138us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636272.260236:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788636272.264041:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a5500 x1875520976334464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636288 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636272.264081:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976334464:0@lo:13: 00000100:00100000:3.0:1788636272.264390:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976334592 00000100:00100000:3.0:1788636272.264398:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976334592 00000100:00100000:3.0:1788636272.273350:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636272.273368:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6962:x1875520976334592:12345-0@lo:700: 00000100:00100000:3.0:1788636272.273426:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6668:1875520976334720:0@lo:700: 00000100:00100000:3.0:1788636272.273489:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636272.273547:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5a497900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636272.275097:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976334720 00000100:00100000:1.0:1788636272.275109:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976334720 00000100:00100000:1.0:1788636272.275169:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636272.275178:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6668:x1875520976334720:12345-0@lo:700: 40000000:02000000:3.0:1788636272.306506:0:5817:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788636272.312434:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d296300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6668:x1875520976334720:12345-0@lo:700: Request processed in 37248us (38936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636272.312455:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788636272.312534:0:6668:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d296d80 x1875520976334720/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788636288 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636272.312549:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6668:1875520976334720:0@lo:700: 40000000:02000000:3.0:1788636272.312574:0:6668:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1788636272.381460:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6962:x1875520976334592:12345-0@lo:700: Request processed in 108090us (122214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636272.381478:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788636272.381615:0:6962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a5f80 x1875520976334592/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788636288 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636272.381645:0:6962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875520976334592:0@lo:700: 00000004:02000040:2.0:1788636272.461931:0:6962:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788636272.471861:0:6962:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875520976334848:0@lo:5: 00000100:00100000:3.0:1788636272.472099:0:6962:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636272.472383:0:6962:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5a4979c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636272.472422:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976334848 00000100:00100000:2.0:1788636272.472431:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976334848 00000100:00100000:2.0:1788636272.472481:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788636272.472490:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6962:x1875520976334848:12345-0@lo:5: 00002000:00080000:3.0:1788636272.484392:0:6662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788636272.484411:0:6662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788636272.487300:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d295f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6962:x1875520976334848:12345-0@lo:5: Request processed in 14804us (15196us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788636272.487331:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788636272.489348:0:6962:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d296d80 x1875520976334848/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636288 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636272.489367:0:6962:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6962:1875520976334848:0@lo:5: 00000004:00080000:2.0:1788636272.489383:0:6962:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:00080000:2.0:1788636272.778508:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788636273.218104:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636274.241174:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636275.263425:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636276.287450:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636276.865912:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976334976:0@lo:400: 00000100:00100000:0.0:1788636276.866265:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636276.866328:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636276.866336:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976335104:0@lo:400: 00000100:00100000:0.0:1788636276.866362:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636276.866397:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976335104 00000100:00100000:0.0:1788636276.866404:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976335104 00000100:00100000:0.0:1788636276.866444:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636276.866453:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976335104:12345-0@lo:400: 00000100:00100000:0.0:1788636276.866738:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976335104:12345-0@lo:400: Request processed in 285us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636276.866747:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636276.866756:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976334976 00000100:00100000:3.0:1788636276.866763:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976334976 00010000:00080000:0.0:1788636276.866793:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d295180 x1875520976335104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636276.866824:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788636276.866835:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:3280:x1875520976334976:12345-0@lo:400: 00000100:00100000:0.0:1788636276.866855:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976335104:0@lo:400: 00000100:00100000:3.0:1788636276.866881:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:3280:x1875520976334976:12345-0@lo:400: Request processed in 47us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636276.866888:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788636276.867013:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976334976:0@lo:400: 00000100:00100000:1.0:1788636276.870285:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976335232:0@lo:400: 00000100:00100000:1.0:1788636276.870359:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636276.870407:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636276.870414:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976335360:0@lo:400: 00000100:00100000:1.0:1788636276.870439:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636276.870624:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976335232 00000100:00100000:1.0:1788636276.870632:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976335232 00000100:00100000:1.0:1788636276.870686:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636276.870695:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976335232:12345-0@lo:400: 00000100:00100000:1.0:1788636276.870751:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976335232:12345-0@lo:400: Request processed in 56us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636276.870759:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636276.870785:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976335360 00000100:00100000:1.0:1788636276.870827:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976335360 00000100:00100000:1.0:1788636276.870861:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636276.870868:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976335360:12345-0@lo:400: 00000100:00100000:1.0:1788636276.871066:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976335360:12345-0@lo:400: Request processed in 198us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636276.871073:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788636276.871089:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636276.871093:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788636276.871119:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d296680 x1875520976335360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636276.871129:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1788636276.871146:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976335360:0@lo:400: 00010000:00080000:1.0:1788636276.871158:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d296a00 x1875520976335232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636292 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636276.871166:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976335232:0@lo:400: 00010000:00010000:1.0:1788636277.312047:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636277.375920:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976335488:0@lo:13: 00000100:00100000:0.0:1788636277.375999:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636277.376087:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976335488 00000100:00100000:2.0:1788636277.376096:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976335488 00000100:00100000:2.0:1788636277.376142:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636277.376150:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976335488:12345-0@lo:13: 00002000:00000024:2.0:1788636277.376180:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636277.376229:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976335488:12345-0@lo:13: Request processed in 80us (231us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636277.376236:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788636277.376273:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd7a282d80 x1875520976335488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636293 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636277.376293:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976335488:0@lo:13: 00010000:00010000:0.0:1788636278.334989:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788636279.056377:0:7608:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788636279.056382:0:7608:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788636279.056533:0:7608:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cfd613ba800 00000020:01000004:1.0:1788636279.056548:0:7608:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788636279.056561:0:7608:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788636279.056574:0:7608:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cfd76a50000) 00000020:00000080:1.0:1788636279.056589:0:7608:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788636279.073899:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1788636279.074346:0:7608:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788636279.097959:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788636279.102516:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788636279.102555:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788636279.102696:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788636279.102736:0:7608:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788636279.103202:0:7608:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788636279.103213:0:7608:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788636279.103223:0:7608:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa6aa59fb12fa713e 00000020:01000004:1.0:1788636279.103230:0:7608:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1788636279.103250:0:7608:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.157@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788636279.103253:0:7608:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788636279.103259:0:7608:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788636279.103279:0:7608:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1788636279.103283:0:7608:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.157@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788636279.118751:0:7608:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788636279.118789:0:7608:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.157@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788636279.118865:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788636279.118868:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788636279.118870:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636279.118871:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636279.118872:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636279.118873:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636279.118874:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636279.118876:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788636279.118877:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788636279.118879:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636279.118880:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788636279.118884:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788636279.118886:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788636279.118888:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788636279.118889:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636279.118890:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636279.118891:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636279.118892:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636279.118893:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636279.118894:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788636279.118895:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788636279.118896:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636279.118897:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788636279.118925:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788636279.118949:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976335616:0@lo:253: 00000100:00100000:1.0:1788636279.119027:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.119132:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61140b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636279.119245:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976335616 00000100:00100000:0.0:1788636279.119252:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976335616 00000100:00100000:0.0:1788636279.119336:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788636279.119346:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:7608:x1875520976335616:12345-0@lo:253: 20000000:01000000:0.0:1788636279.119374:0:5805:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788636279.119379:0:5805:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788636279.119384:0:5805:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788636279.119387:0:5805:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788636279.120318:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636279.120494:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788636279.120506:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788636279.120538:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788636279.120544:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788636279.120568:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788636279.120690:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788636279.121094:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788636279.121113:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.157@tcp 20000000:01000000:0.0:1788636279.121116:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.157@tcp (null) (null) (null) 00000040:00080000:0.0:1788636279.121147:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788636279.121154:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788636279.121199:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788636279.121206:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.157@tcp (null) (null) 00000040:00080000:0.0:1788636279.121241:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788636279.121253:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788636279.121278:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788636279.121313:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788636279.122330:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788636279.122349:0:5805:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.157@tcp 20000000:01000000:0.0:1788636279.122350:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.157@tcp (null) (null) (null) 00000040:00080000:0.0:1788636279.122379:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788636279.122387:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788636279.122415:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788636279.122421:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.157@tcp (null) (null) 00000040:00080000:0.0:1788636279.122644:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788636279.122661:0:5805:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788636279.122713:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788636279.122752:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788636279.122769:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788636279.122772:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788636279.122778:0:5805:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788636279.122779:0:5805:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788636279.122782:0:5805:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788636279.122793:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788636279.122879:0:5805:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788636279.123002:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788636279.123005:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788636279.123784:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788636279.123890:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788636279.123923:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788636279.124184:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788636279.124223:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788636279.124381:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788636279.124397:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788636279.124399:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788636279.124992:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788636279.125184:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788636279.125213:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788636279.125260:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788636279.125270:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788636279.125271:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788636279.125593:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1788636279.125621:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1788636279.125649:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788636279.125783:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788636279.125877:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788636279.125909:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788636279.125917:0:5805:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788636279.125918:0:5805:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788636279.126263:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1788636279.126308:0:7613:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1788636279.126356:0:7613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1788636279.126626:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788636279.126658:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788636279.126682:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:3.0:1788636279.126704:0:5805:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788636279.126723:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.126740:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.126747:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.126753:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.126759:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.126765:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.126772:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.126899:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.126914:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 16 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636279.126928:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976335744:0@lo:104: 00000100:00100000:3.0:1788636279.127003:0:5805:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636279.127049:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.127062:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 16 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636279.127070:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d297800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976335872:0@lo:104: 00010000:00010000:3.0:1788636279.127092:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.127099:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 16 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636279.127105:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d297100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976336000:0@lo:104: 00010000:00010000:3.0:1788636279.127132:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.127139:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 16 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636279.127145:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976336128:0@lo:104: 00010000:00010000:3.0:1788636279.127159:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.127165:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 16 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636279.127171:0:5805:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d297480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976336256:0@lo:104: 00000100:00100000:3.0:1788636279.127182:0:5805:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636279.127290:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788636279.127309:0:5794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.127332:0:5794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.127341:0:5794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.127350:0:5794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.127360:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976335744 00000100:00100000:2.0:1788636279.127365:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976335744 00000100:00100000:2.0:1788636279.127396:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976335872 00000100:00100000:2.0:1788636279.127399:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976335872 00000100:00100000:2.0:1788636279.127409:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976336000 00000100:00100000:2.0:1788636279.127411:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976336000 00000100:00100000:2.0:1788636279.127419:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976336128 00000100:00100000:2.0:1788636279.127421:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976336128 00000100:00100000:2.0:1788636279.127428:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976336256 00000100:00100000:2.0:1788636279.127430:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976336256 00000100:00100000:2.0:1788636279.127441:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636279.127513:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd61392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+7:5805:x1875520976335744:12345-0@lo:104: 00010000:00010000:2.0:1788636279.127526:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.127615:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636279.127621:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd61392850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+7:5805:x1875520976335744:12345-0@lo:104: Request processed in 111us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.127627:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636279.127659:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636279.127663:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+6:5805:x1875520976335872:12345-0@lo:104: 00010000:00010000:2.0:1788636279.127670:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.127710:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788636279.127715:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+6:5805:x1875520976335872:12345-0@lo:104: Request processed in 52us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.127720:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636279.127730:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636279.127735:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+5:5805:x1875520976336000:12345-0@lo:104: 00010000:00010000:2.0:1788636279.127741:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.127761:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788636279.127765:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+5:5805:x1875520976336000:12345-0@lo:104: Request processed in 31us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.127770:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636279.127779:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636279.127783:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+4:5805:x1875520976336128:12345-0@lo:104: 00010000:00010000:2.0:1788636279.127789:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.127832:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788636279.127837:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+4:5805:x1875520976336128:12345-0@lo:104: Request processed in 54us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.127842:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636279.127852:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636279.127858:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:5805:x1875520976336256:12345-0@lo:104: 00010000:00010000:2.0:1788636279.127864:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.127893:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788636279.127897:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:5805:x1875520976336256:12345-0@lo:104: Request processed in 40us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.127902:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788636279.127916:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788636279.127921:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.127927:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167d000 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636279.127931:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.127939:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636279.127945:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636279.127951:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636279.127988:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.127994:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636279.128011:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128018:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d000/0xa6aa59fb12fa7129 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7130 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128041:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788636279.128044:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128049:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe600 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636279.128052:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128058:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636279.128064:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636279.128070:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636279.128083:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128088:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636279.128101:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128108:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe600/0xa6aa59fb12fa70ff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7106 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128118:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788636279.128121:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128135:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40031e00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636279.128138:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128144:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636279.128149:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636279.128154:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636279.128166:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128172:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636279.128177:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128184:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd40031e00/0xa6aa59fb12fa70e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70ea expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128199:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636279.128202:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128208:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636279.128210:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128226:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636279.128233:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636279.128238:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636279.128250:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128256:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636279.128261:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128268:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d600/0xa6aa59fb12fa70b9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70c0 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128278:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636279.128281:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128286:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fee00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636279.128288:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128294:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636279.128299:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636279.128309:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636279.128323:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128328:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636279.128332:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128338:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521fee00/0xa6aa59fb12fa708f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7096 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128352:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636279.128354:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636279.128355:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636279.128376:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976336384:0@lo:103: 00000100:00100000:2.0:1788636279.128405:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.128433:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976336896:0@lo:103: 00000100:00100000:2.0:1788636279.128463:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.128471:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976336384 00000100:00100000:3.0:1788636279.128476:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976336384 00000100:00100000:2.0:1788636279.128482:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636279.128487:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976336768:0@lo:103: 00010000:00010000:3.0:1788636279.128503:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 17 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636279.128504:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.128524:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976336896 00000100:00100000:3.0:1788636279.128527:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976336896 00000100:00100000:2.0:1788636279.128530:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976336512:0@lo:103: 00010000:00010000:3.0:1788636279.128537:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 18 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636279.128547:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976336768 00000100:00100000:3.0:1788636279.128549:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976336768 00000100:00100000:2.0:1788636279.128550:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636279.128559:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 19 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636279.128560:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636279.128564:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976336640:0@lo:103: 00000100:00100000:3.0:1788636279.128569:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976336512 00000100:00100000:3.0:1788636279.128571:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976336512 00010000:00010000:3.0:1788636279.128579:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 20 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636279.128580:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.128589:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976336640 00000100:00100000:3.0:1788636279.128591:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976336640 00010000:00010000:3.0:1788636279.128601:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 21 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636279.128602:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636279.128613:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636279.128613:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+21:3281:x1875520976336384:12345-0@lo:103: 00000100:00100000:3.0:1788636279.128617:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+21:3281:x1875520976336896:12345-0@lo:103: 00010000:00010000:3.0:1788636279.128624:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636279.128624:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636279.128629:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 21 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128629:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 21 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.128639:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 21 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.128677:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636279.128831:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976335744:0@lo:104: 00000100:00100000:1.0:1788636279.128841:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d297800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976335872:0@lo:104: 00000100:00100000:1.0:1788636279.128848:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d297100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976336000:0@lo:104: 00000100:00100000:1.0:1788636279.128854:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976336128:0@lo:104: 00000100:00100000:1.0:1788636279.128860:0:5805:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d297480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5805:1875520976336256:0@lo:104: 00010000:00010000:3.0:1788636279.128914:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 21 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.128943:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa7096 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa708f expref: 21 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.128956:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636279.128996:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+20:3281:x1875520976336896:12345-0@lo:103: Request processed in 377us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.129002:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636279.129016:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636279.129022:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976336768:12345-0@lo:103: 00010000:00010000:3.0:1788636279.129096:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636279.129100:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 19 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129109:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 19 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129118:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fe400/0xa6aa59fb12fa70c0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa70b9 expref: 19 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129127:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636279.129147:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+18:3281:x1875520976336768:12345-0@lo:103: Request processed in 126us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.129152:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788636279.129165:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636279.129170:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+17:3282:x1875520976336512:12345-0@lo:103: 00010000:00010000:3.0:1788636279.129176:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636279.129180:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 17 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129193:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 17 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129202:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7106 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ff expref: 17 pid: 5805 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129211:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636279.129245:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+16:3282:x1875520976336512:12345-0@lo:103: Request processed in 75us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.129251:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788636279.129263:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636279.129268:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+15:3282:x1875520976336640:12345-0@lo:103: 00010000:00010000:3.0:1788636279.129275:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636279.129278:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 15 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129287:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 15 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129296:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa70ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa70e3 expref: 15 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.129305:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636279.129321:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+14:3282:x1875520976336640:12345-0@lo:103: Request processed in 53us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.129326:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636279.129350:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976336640:0@lo:103: 00000100:00100000:3.0:1788636279.129357:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a283b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976336512:0@lo:103: 00000100:00100000:3.0:1788636279.129381:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976336768:0@lo:103: 00000100:00100000:3.0:1788636279.129387:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976336896:0@lo:103: 00010000:00010000:2.0:1788636279.129892:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997c400/0xa6aa59fb12fa7130 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7129 expref: 13 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.129893:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129914:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129921:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129934:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129939:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129944:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129948:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129951:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636279.129954:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129979:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.129996:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.130006:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636279.130017:0:5805:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.130027:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.130041:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa7145 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788636279.130059:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788636279.130061:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+12:3281:x1875520976336384:12345-0@lo:103: Request processed in 1446us (1653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.130070:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636279.130195:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976336384:0@lo:103: 00000100:00100000:3.0:1788636279.183973:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+11:7608:x1875520976335616:12345-0@lo:253: Request processed in 64611us (64929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.183988:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788636279.184181:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976335616:0@lo:253: 10000000:01000000:1.0:1788636279.184198:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788636279.184201:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788636279.184203:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788636279.184204:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636279.184206:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788636279.184207:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636279.184208:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636279.184209:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636279.184211:0:7608:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788636279.184212:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636279.184213:0:7608:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788636279.184233:0:7608:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cfd613ba800 from lustre-OST0001 10000000:01000000:1.0:1788636279.184257:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788636279.184259:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788636279.184267:0:7608:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cfd5d20cd40 local copy 10000000:01000000:1.0:1788636279.184271:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788636279.184305:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.184315:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.184324:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636279.184339:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337024:0@lo:101: 00000100:00100000:1.0:1788636279.184389:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.184489:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636279.184750:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976337024 00000100:00100000:0.0:1788636279.184757:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976337024 00000100:00100000:0.0:1788636279.184848:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788636279.184859:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+11:7608:x1875520976337024:12345-0@lo:101: 00010000:00010000:0.0:1788636279.184870:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636279.184884:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7153 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa714c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.184907:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa714c expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.184925:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7153 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa714c expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.184933:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031600, rc 0) 00000100:00100000:0.0:1788636279.185415:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337024:12345-0@lo:101: Request processed in 557us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636279.185421:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788636279.185655:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337024:0@lo:101: 00010000:00010000:1.0:1788636279.185776:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.185787:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636279.185901:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337152:0@lo:501: 00000100:00100000:1.0:1788636279.185931:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.186015:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611409c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636279.186217:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976337152 00000100:00100000:0.0:1788636279.186223:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976337152 00000100:00100000:0.0:1788636279.186265:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788636279.186274:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337152:12345-0@lo:501: 00000100:00100000:0.0:1788636279.186487:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337152:12345-0@lo:501: Request processed in 214us (554us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636279.186495:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788636279.186584:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337152:0@lo:501: 10000000:01000000:1.0:1788636279.186598:0:7608:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788636279.186625:0:7608:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788636279.186631:0:7608:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.186651:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.186659:0:7608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.187251:0:7608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788636279.187275:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cfd613ba800 10000000:01000000:1.0:1788636279.187280:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788636279.187286:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788636279.187296:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636279.187301:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788636279.187303:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788636279.187327:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.187335:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.187344:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636279.187360:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337280:0@lo:101: 00000100:00100000:1.0:1788636279.187394:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.187434:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61140480 going to sleep for 11 seconds 00010000:00010000:0.0:1788636279.187496:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636279.187502:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.187510:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167d200 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636279.187513:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.187522:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636279.187529:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636279.187547:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636279.187566:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.187573:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636279.187600:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.187608:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa714c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xa6aa59fb12fa7153 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.187620:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636279.187622:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636279.187624:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636279.187631:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636279.187642:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976337408:0@lo:103: 00000100:00100000:0.0:1788636279.187684:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.188357:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976337280 00000100:00100000:2.0:1788636279.188364:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976337280 00000100:00100000:2.0:1788636279.188405:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788636279.188414:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337280:12345-0@lo:101: 00010000:00010000:2.0:1788636279.188424:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636279.188439:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa715a expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.188464:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.188474:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.188483:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fee00, rc 0) 00000100:00100000:2.0:1788636279.188523:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976337280:12345-0@lo:101: Request processed in 110us (1128us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.188530:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788636279.189519:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976337408 00000100:00100000:3.0:1788636279.189527:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976337408 00000100:00100000:3.0:1788636279.189607:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636279.189617:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+13:3283:x1875520976337408:12345-0@lo:103: 00010000:00010000:3.0:1788636279.189629:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636279.189655:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7153 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa714c expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.189677:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636279.189730:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+12:3283:x1875520976337408:12345-0@lo:103: Request processed in 115us (2045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.189737:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636279.189826:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976337408:0@lo:103: 00000100:00100000:1.0:1788636279.190547:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337280:0@lo:101: 00010000:00010000:1.0:1788636279.190567:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.190649:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636279.190755:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337536:0@lo:501: 00000100:00100000:1.0:1788636279.190817:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.190846:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61140480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636279.191776:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976337536 00000100:00100000:2.0:1788636279.191787:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976337536 00000100:00100000:2.0:1788636279.191863:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788636279.191872:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337536:12345-0@lo:501: 00000100:00100000:2.0:1788636279.192161:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337536:12345-0@lo:501: Request processed in 289us (1363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.192168:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788636279.193856:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337536:0@lo:501: 00000100:00100000:1.0:1788636279.193914:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337664:0@lo:503: 00000100:00100000:1.0:1788636279.193998:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.194039:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61140480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636279.194849:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976337664 00000100:00100000:2.0:1788636279.194858:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976337664 00000100:00100000:2.0:1788636279.194911:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788636279.194923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337664:12345-0@lo:503: 00000100:00100000:2.0:1788636279.195174:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337664:12345-0@lo:503: Request processed in 254us (1175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.195181:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788636279.195344:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337664:0@lo:503: 00000040:00080000:0.0:1788636279.195826:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788636279.195902:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337792:0@lo:502: 00000100:00100000:0.0:1788636279.195953:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636279.195994:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd48eb7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636279.196273:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976337792 00000100:00100000:1.0:1788636279.196279:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976337792 00000100:00100000:1.0:1788636279.196316:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636279.196325:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337792:12345-0@lo:502: 00000100:00100000:1.0:1788636279.196944:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337792:12345-0@lo:502: Request processed in 618us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.196951:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788636279.197081:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337792:0@lo:502: 00000040:00080000:0.0:1788636279.197512:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788636279.197567:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788636279.197602:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788636279.197989:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788636279.198043:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788636279.198318:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788636279.198355:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337920:0@lo:502: 00000100:00100000:1.0:1788636279.198410:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.198480:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61140480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636279.198520:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976337920 00000100:00100000:0.0:1788636279.198526:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976337920 00000100:00100000:0.0:1788636279.198616:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788636279.198627:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337920:12345-0@lo:502: 00000100:00100000:0.0:1788636279.198859:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976337920:12345-0@lo:502: Request processed in 234us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636279.198866:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788636279.198958:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976337920:0@lo:502: 00000040:00080000:1.0:1788636279.199080:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788636279.199098:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788636279.199416:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636279.199424:0:7616:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788636279.199430:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636279.199433:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788636279.199438:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636279.199453:0:7616:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cfd76a519c0) 00000020:00000080:1.0:1788636279.199471:0:7616:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788636279.199477:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788636279.199541:0:7616:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd613ba800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788636279.199548:0:7616:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788636279.199554:0:7616:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa6aa59fb12fa716f 00010000:00010000:1.0:1788636279.203620:0:7616:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788636279.204323:0:7616:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788636279.208714:0:7616:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788636279.209384:0:7616:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788636279.215992:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788636279.216546:0:7616:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788636279.218608:0:7616:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788636279.218620:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636279.218627:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636279.218629:0:7616:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788636279.218633:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636279.218637:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636279.218638:0:7616:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636279.218654:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636279.218656:0:7616:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788636279.219782:0:7616:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636279.219790:0:7616:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636279.219792:0:7616:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788636279.219831:0:7616:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788636279.220081:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788636279.220114:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788636279.220137:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.220150:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636279.220159:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613ba800 from 1 10000000:01000000:3.0:1788636279.220176:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636279.220210:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.220219:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.220230:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636279.220254:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d297b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338048:0@lo:101: 00000100:00100000:3.0:1788636279.220317:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.220353:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636279.223828:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976338048 00000100:00100000:0.0:1788636279.223839:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976338048 00000100:00100000:0.0:1788636279.223895:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636279.223905:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:7608:x1875520976338048:12345-0@lo:101: 00010000:00010000:0.0:1788636279.223922:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636279.223938:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7176 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.223973:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.223986:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636279.223995:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40030e00, rc 0) 00000100:00100000:0.0:1788636279.224064:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976338048:12345-0@lo:101: Request processed in 161us (3747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636279.224082:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788636279.224200:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d297b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338048:0@lo:101: 00010000:00010000:1.0:1788636279.224218:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.224228:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636279.224331:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338176:0@lo:501: 00000100:00100000:1.0:1788636279.224365:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.224396:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61140600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636279.224411:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976338176 00000100:00100000:1.0:1788636279.224415:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976338176 00000100:00100000:1.0:1788636279.224432:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636279.224438:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976338176:12345-0@lo:501: 00000100:00100000:1.0:1788636279.227397:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976338176:12345-0@lo:501: Request processed in 2949us (3021us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.227417:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338176:0@lo:501: 00000100:00100000:1.0:1788636279.227422:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788636279.227485:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338304:0@lo:503: 00000100:00100000:3.0:1788636279.227543:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.227579:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636279.228298:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976338304 00000100:00100000:2.0:1788636279.228307:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976338304 00000100:00100000:2.0:1788636279.228356:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788636279.228368:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976338304:12345-0@lo:503: 00000100:00100000:2.0:1788636279.231373:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976338304:12345-0@lo:503: Request processed in 3001us (3823us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.231388:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788636279.237909:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338304:0@lo:503: 00000040:00080000:3.0:1788636279.238954:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788636279.239048:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338432:0@lo:502: 00000100:00100000:3.0:1788636279.239230:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.239267:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636279.239446:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976338432 00000100:00100000:1.0:1788636279.239453:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976338432 00000100:00100000:1.0:1788636279.239503:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788636279.239513:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976338432:12345-0@lo:502: 00000100:00100000:1.0:1788636279.239738:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976338432:12345-0@lo:502: Request processed in 226us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.239746:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636279.240905:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338432:0@lo:502: 00000040:00080000:3.0:1788636279.241287:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788636279.241344:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788636279.241376:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338560:0@lo:502: 00000100:00100000:3.0:1788636279.241431:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.242248:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636279.249213:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976338560 00000100:00100000:0.0:1788636279.249228:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976338560 00000100:00100000:0.0:1788636279.250900:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788636279.250932:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976338560:12345-0@lo:502: 00000100:00100000:0.0:1788636279.251233:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976338560:12345-0@lo:502: Request processed in 304us (9801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.256906:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338560:0@lo:502: 00000040:00080000:2.0:1788636279.257166:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788636279.257185:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788636279.260366:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636279.260383:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636279.260386:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788636279.260394:0:7620:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd613ba800 00000020:00000080:1.0:1788636279.260397:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636279.260420:0:7620:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636279.260423:0:7620:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636279.260425:0:7620:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788636279.260429:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1788636279.260506:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1788636279.260531:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636279.260551:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.260565:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636279.260616:0:7608:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788636279.260620:0:7608:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cfd613ba800 10000000:01000000:1.0:1788636279.260624:0:7608:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cfd613ba800 10000000:01000000:1.0:1788636279.260628:0:7608:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636279.260652:0:7608:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd613ba800 from 1 10000000:01000000:1.0:1788636279.260656:0:7608:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788636279.260694:0:7608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.260703:0:7608:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.260713:0:7608:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636279.260735:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338688:0@lo:101: 00000100:00100000:1.0:1788636279.260821:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.260857:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636279.261064:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976338688 00000100:00100000:3.0:1788636279.261072:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976338688 00000100:00100000:3.0:1788636279.261104:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788636279.261113:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976338688:12345-0@lo:101: 00010000:00010000:3.0:1788636279.261126:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636279.261138:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7184 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.261160:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.261171:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.261180:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636279.261220:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:7608:x1875520976338688:12345-0@lo:101: Request processed in 107us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.261227:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788636279.261393:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788636279.261671:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338688:0@lo:101: 00010000:00010000:1.0:1788636279.261686:0:7608:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.261695:0:7608:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636279.261785:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338816:0@lo:501: 00000100:00100000:1.0:1788636279.261855:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.261884:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611409c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636279.261904:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976338816 00000100:00100000:1.0:1788636279.261908:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976338816 00000100:00100000:1.0:1788636279.261930:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788636279.261937:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976338816:12345-0@lo:501: 00000100:00100000:1.0:1788636279.262159:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976338816:12345-0@lo:501: Request processed in 221us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.262172:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788636279.262265:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338816:0@lo:501: 00000100:00100000:2.0:1788636279.262302:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338944:0@lo:503: 00000100:00100000:2.0:1788636279.262340:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.262360:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636279.262415:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976338944 00000100:00100000:3.0:1788636279.262419:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976338944 00000100:00100000:3.0:1788636279.262438:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788636279.262456:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976338944:12345-0@lo:503: 00000100:00100000:3.0:1788636279.262605:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976338944:12345-0@lo:503: Request processed in 159us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.262612:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788636279.262727:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976338944:0@lo:503: 00000040:00080000:2.0:1788636279.263012:0:7608:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636279.263066:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976339072:0@lo:502: 00000100:00100000:2.0:1788636279.263101:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.263125:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636279.263191:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976339072 00000100:00100000:1.0:1788636279.263196:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976339072 00000100:00100000:1.0:1788636279.263215:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788636279.263222:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976339072:12345-0@lo:502: 00000100:00100000:1.0:1788636279.263536:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976339072:12345-0@lo:502: Request processed in 314us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.263543:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788636279.264044:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976339072:0@lo:502: 00000040:00080000:2.0:1788636279.264311:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788636279.264361:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788636279.264394:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788636279.264456:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788636279.264496:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788636279.264542:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788636279.264589:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788636279.264621:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788636279.264666:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788636279.264704:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788636279.264737:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788636279.264781:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788636279.268328:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788636279.268385:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788636279.268476:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788636279.268531:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788636279.268566:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788636279.268615:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788636279.268652:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788636279.268688:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788636279.268738:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788636279.268776:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788636279.268849:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788636279.268899:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788636279.268936:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1788636279.268982:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1788636279.269033:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1788636279.269089:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1788636279.269125:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1788636279.269186:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1788636279.269224:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1788636279.269259:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1788636279.269293:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1788636279.269355:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1788636279.269396:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1788636279.269447:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1788636279.269485:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1788636279.269537:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976339200:0@lo:502: 00000100:00100000:3.0:1788636279.269617:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.270651:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636279.271578:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976339200 00000100:00100000:0.0:1788636279.271587:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976339200 00000100:00100000:0.0:1788636279.271647:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788636279.271657:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976339200:12345-0@lo:502: 00000100:00100000:0.0:1788636279.272086:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976339200:12345-0@lo:502: Request processed in 430us (2468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636279.272095:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788636279.272216:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976339200:0@lo:502: 00000040:00080000:3.0:1788636279.272315:0:7608:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:3.0:1788636279.272327:0:7608:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1788636279.273038:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788636279.273064:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cfc42e4cd40) 00000020:00000080:0.0:1788636279.273084:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788636279.273146:0:7621:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd613ba800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788636279.273150:0:7621:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd613ba800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788636279.273153:0:7621:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd613ba800 3 00010000:00080000:0.0:1788636279.273179:0:7621:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd45a2b000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.157@tcp at head 00010000:00010000:0.0:1788636279.276287:0:7621:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788636279.276527:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788636279.276565:0:7621:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788636279.276577:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa6aa59fb12fa7199 00000100:00080000:0.0:1788636279.276588:0:7621:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636279.276594:0:7621:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cfd45a2b000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:0.0:1788636279.276631:0:7621:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd756a4a80 x1875520976339328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636279.276657:0:7621:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788636279.280376:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1875520976339328:0@lo:38: 00000100:00100000:1.0:1788636279.280469:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.280533:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976339328 00000100:00100000:1.0:1788636279.280540:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976339328 00000100:00100000:1.0:1788636279.280575:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636279.280583:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3279:x1875520976339328:12345-0@lo:38: 00010000:00080000:1.0:1788636279.280613:0:5811:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:1.0:1788636279.280669:0:5811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa6aa59fb12fa71a0 00000004:00100000:1.0:1788636279.280685:0:5811:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788636279.280718:0:5811:0:(import.c:65:import_set_state_nolock()) ffff9cfd75eaf000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636279.280768:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875520976339328:12345-0@lo:38: Request processed in 184us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.280776:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788636279.280852:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd756a4a80 x1875520976339328/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636279.280863:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636279.280871:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1788636279.280878:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788636279.280889:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788636279.280891:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd45a2b000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636279.280897:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1875520976339328:0@lo:38: 00000100:00100000:1.0:1788636279.281127:0:7623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7623:1875520976339456:0@lo:901: 00000100:00100000:1.0:1788636279.281156:0:7623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.281172:0:7623:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d27cd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788636279.281194:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976339456 00000100:00100000:1.0:1788636279.281198:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976339456 00000100:00100000:1.0:1788636279.281235:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636279.281243:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7623:x1875520976339456:12345-0@lo:901: 00000100:00100000:1.0:1788636279.281596:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7623:x1875520976339456:12345-0@lo:901: Request processed in 354us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.281604:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:1.0:1788636279.281622:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788636279.281642:0:7623:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd76a38a80 x1875520976339456/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788636295 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636279.281653:0:7623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7623:1875520976339456:0@lo:901: 00000040:00080000:1.0:1788636279.281822:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:3.0:1788636279.285858:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976339712:0@lo:400: 00000100:00100000:3.0:1788636279.285927:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.285994:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636279.286001:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976339840:0@lo:400: 00000100:00100000:3.0:1788636279.286029:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.286067:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976339840 00000100:00100000:3.0:1788636279.286074:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976339840 00000100:00100000:3.0:1788636279.286128:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636279.286138:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976339840:12345-0@lo:400: 00000100:00100000:3.0:1788636279.286188:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976339840:12345-0@lo:400: Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636279.286197:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788636279.286237:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d295500 x1875520976339840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636279.286252:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976339840:0@lo:400: 00000020:01000000:3.0:1788636279.286277:0:7608:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1788636279.286312:0:7608:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636279.286325:0:7608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.286336:0:7608:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788636279.286383:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788636279.286385:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788636279.286386:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636279.286387:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636279.286388:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636279.286390:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636279.286391:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636279.286393:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788636279.286394:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788636279.286396:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636279.286402:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636279.286406:0:7608:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1788636279.286408:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788636279.286410:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788636279.286410:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636279.286411:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636279.286412:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636279.286413:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636279.286414:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636279.286415:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788636279.286416:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788636279.286417:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636279.286418:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636279.286432:0:7608:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788636279.286580:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976339584:0@lo:400: 00000100:00100000:0.0:1788636279.286619:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636279.286761:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976339712 00000100:00100000:1.0:1788636279.286766:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976339712 00000100:00100000:1.0:1788636279.286809:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976339584 00000100:00100000:1.0:1788636279.286813:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976339584 00000100:00100000:1.0:1788636279.286829:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788636279.286835:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976339712:12345-0@lo:400: 00000100:00100000:1.0:1788636279.286878:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976339712:12345-0@lo:400: Request processed in 43us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.286885:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788636279.286906:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636279.286913:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976339584:12345-0@lo:400: 00000100:00100000:1.0:1788636279.286949:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976339584:12345-0@lo:400: Request processed in 37us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.286956:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788636279.286983:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636279.286988:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636279.287015:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d294700 x1875520976339712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636279.287027:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976339712:0@lo:400: 00010000:00080000:1.0:1788636279.287050:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd5d294000 x1875520976339584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636279.287058:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976339584:0@lo:400: 00000100:00100000:3.0:1788636279.289196:0:7608:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976339968:0@lo:253: 00000100:00100000:3.0:1788636279.289256:0:7608:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.289293:0:7608:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636279.290066:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976339968 00000100:00100000:2.0:1788636279.290073:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976339968 00000100:00100000:2.0:1788636279.290120:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788636279.290129:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+14:7608:x1875520976339968:12345-0@lo:253: 20000000:01000000:2.0:1788636279.290157:0:5804:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788636279.290172:0:5804:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788636279.359378:0:5804:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788636279.359393:0:5804:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788636279.360358:0:5826:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788636279.360364:0:5826:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788636279.360386:0:5826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.360405:0:5826:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.360414:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.360464:0:5826:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636279.360478:0:5826:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 14 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636279.360492:0:5826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1875520976340096:0@lo:104: 00000100:00100000:3.0:1788636279.360566:0:5826:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636279.360615:0:5826:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636279.361050:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976340096 00000100:00100000:2.0:1788636279.361064:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976340096 00000100:00100000:2.0:1788636279.361125:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636279.361134:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:5826:x1875520976340096:12345-0@lo:104: 00010000:00010000:2.0:1788636279.361147:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361201:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636279.361206:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:5826:x1875520976340096:12345-0@lo:104: Request processed in 75us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.361213:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788636279.361238:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636279.361246:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361254:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40031000 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636279.361259:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361269:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636279.361277:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636279.361283:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788636279.361317:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361325:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636279.361346:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361365:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd40031000/0xa6aa59fb12fa70f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70f8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361383:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636279.361385:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636279.361387:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636279.361411:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976340224:0@lo:103: 00000100:00100000:2.0:1788636279.361454:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636279.361494:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976340224 00000100:00100000:2.0:1788636279.361498:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976340224 00010000:00010000:2.0:1788636279.361514:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 15 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636279.361536:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636279.361542:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+15:3282:x1875520976340224:12345-0@lo:103: 00010000:00010000:2.0:1788636279.361552:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636279.361557:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 15 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361567:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 15 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361582:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361590:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788636279.361602:0:5795:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004805342s 00010000:00010000:2.0:1788636279.361613:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361620:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361627:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361634:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361639:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636279.361643:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361650:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361658:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361667:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636279.361698:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699a8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+15:3282:x1875520976340224:12345-0@lo:103: Request processed in 156us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636279.361704:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636279.361757:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976340224:0@lo:103: 00010000:00010000:2.0:1788636279.361784:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa70f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa70f1 expref: 14 pid: 5803 timeout: 298 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636279.361828:0:5826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5826:1875520976340096:0@lo:104: 00010000:00010000:2.0:1788636279.361848:0:5826:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361858:0:5826:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361865:0:5826:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636279.361871:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa71a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636279.362618:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636279.387043:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:7608:x1875520976339968:12345-0@lo:253: Request processed in 96906us (97778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636279.387057:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788636279.387274:0:7608:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:1196c107-eaca-4490-96fc-d60d67da8edc:7608:1875520976339968:0@lo:253: 10000000:01000000:3.0:1788636279.387290:0:7608:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788636279.387293:0:7608:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788636279.387295:0:7608:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788636279.387296:0:7608:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636279.387297:0:7608:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636279.387298:0:7608:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636279.387299:0:7608:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636279.387301:0:7608:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636279.387302:0:7608:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788636279.387303:0:7608:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788636279.387305:0:7608:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636279.387306:0:7608:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788636279.387320:0:7608:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788636279.396046:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636279.396527:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788636279.396746:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636279.397549:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788636279.398050:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788636279.398296:0:7608:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788636279.405756:0:7608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788636279.710419:0:7608:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788636279.710427:0:7608:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788636279.710460:0:7608:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788636279.710684:0:7608:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788636279.710701:0:7608:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788636279.710730:0:7608:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788636280.383053:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636281.408024:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636282.431510:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636282.495427:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636282.495454:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976340352:0@lo:13: 00000100:00100000:3.0:1788636282.495520:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636282.495780:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976340352 00000100:00100000:1.0:1788636282.495788:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976340352 00000100:00100000:1.0:1788636282.495871:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636282.495880:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976340352:12345-0@lo:13: 00002000:00000024:1.0:1788636282.495915:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636282.495973:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976340352:12345-0@lo:13: Request processed in 95us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636282.495992:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788636282.496032:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd5d295500 x1875520976340352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636298 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636282.496052:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976340352:0@lo:13: 00000100:00080000:3.0:1788636282.496123:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788636283.456586:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636284.479113:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636284.544164:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976340608:0@lo:400: 00000100:00100000:2.0:1788636284.544236:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636284.544296:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788636284.544303:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976340480:0@lo:400: 00000100:00100000:2.0:1788636284.544341:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636284.544361:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976340992:0@lo:400: 00000100:00100000:2.0:1788636284.544395:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636284.544419:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976340736:0@lo:400: 00000100:00100000:2.0:1788636284.544450:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636284.544469:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636284.544474:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976340864:0@lo:400: 00000100:00100000:2.0:1788636284.544496:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636284.544524:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976340608 00000100:00100000:2.0:1788636284.544531:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976340608 00000100:00100000:2.0:1788636284.544571:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976340992 00000100:00100000:2.0:1788636284.544573:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976340992 00000100:00100000:2.0:1788636284.544594:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976340736 00000100:00100000:2.0:1788636284.544597:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976340736 00000100:00100000:2.0:1788636284.544611:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636284.544618:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976340608:12345-0@lo:400: 00000100:00100000:2.0:1788636284.544666:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976340608:12345-0@lo:400: Request processed in 47us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636284.544672:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636284.544688:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636284.544694:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976340992:12345-0@lo:400: 00000100:00100000:2.0:1788636284.544719:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976340992:12345-0@lo:400: Request processed in 26us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636284.544724:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636284.544735:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636284.544741:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976340736:12345-0@lo:400: 00000100:00100000:2.0:1788636284.544770:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976340736:12345-0@lo:400: Request processed in 30us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636284.544784:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636284.544835:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976340864 00000100:00100000:2.0:1788636284.544839:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976340864 00000100:00100000:2.0:1788636284.544866:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788636284.544873:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976340864:12345-0@lo:400: 00000100:00100000:1.0:1788636284.545067:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976340480 00000100:00100000:1.0:1788636284.545072:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976340480 00000100:00100000:1.0:1788636284.545121:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788636284.545129:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:3281:x1875520976340480:12345-0@lo:400: 00000100:00100000:1.0:1788636284.545162:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:3281:x1875520976340480:12345-0@lo:400: Request processed in 34us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636284.545167:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1788636284.545219:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636284.545224:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636284.545254:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976340480:0@lo:400: 00010000:00080000:1.0:1788636284.545269:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a280000 x1875520976340992/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636284.545280:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976340992:0@lo:400: 00010000:00080000:1.0:1788636284.545289:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a280e00 x1875520976340608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636284.545297:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976340608:0@lo:400: 00000100:00100000:2.0:1788636284.546032:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976340864:12345-0@lo:400: Request processed in 1157us (1533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636284.546041:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788636284.546079:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a281880 x1875520976340864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636284.546091:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976340864:0@lo:400: 00010000:00080000:2.0:1788636284.546115:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a283800 x1875520976340736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636284.546124:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976340736:0@lo:400: 00010000:00010000:0.0:1788636285.508402:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788636285.541648:0:7964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 10000000:01000000:1.0:1788636285.569659:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788636285.569667:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd76a12000 from 30 10000000:01000000:1.0:1788636285.569673:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788636285.569727:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.569738:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.569748:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636285.569770:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341120:0@lo:101: 00000100:00100000:1.0:1788636285.570243:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.570293:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61066c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636285.570316:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976341120 00000100:00100000:1.0:1788636285.570323:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976341120 00000100:00100000:1.0:1788636285.570370:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636285.570379:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976341120:12345-0@lo:101: 00010000:00010000:1.0:1788636285.570390:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636285.570404:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa71ae expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.570426:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.570436:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 14 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.570445:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167de00, rc 0) 00000100:00100000:1.0:1788636285.570479:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976341120:12345-0@lo:101: Request processed in 102us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.570486:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788636285.570542:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341120:0@lo:101: 00010000:00010000:1.0:1788636285.570556:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.570565:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636285.570611:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341248:0@lo:501: 00000100:00100000:1.0:1788636285.570636:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.570649:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61066c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636285.570661:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976341248 00000100:00100000:1.0:1788636285.570664:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976341248 00000100:00100000:1.0:1788636285.570685:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788636285.570691:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976341248:12345-0@lo:501: 00000100:00100000:0.0:1788636285.571439:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976341248:12345-0@lo:501: Request processed in 745us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.571448:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788636285.571551:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341248:0@lo:501: 00000100:00100000:1.0:1788636285.571580:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341376:0@lo:503: 00000100:00100000:1.0:1788636285.571619:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.571951:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61066c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.572137:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976341376 00000100:00100000:0.0:1788636285.572143:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976341376 00000100:00100000:0.0:1788636285.572192:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788636285.572201:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976341376:12345-0@lo:503: 00000100:00100000:0.0:1788636285.572489:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976341376:12345-0@lo:503: Request processed in 288us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.572496:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788636285.572975:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341376:0@lo:503: 00000100:00100000:1.0:1788636285.573508:0:7966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7966:1875520976341504:0@lo:502: 00000100:00100000:1.0:1788636285.573560:0:7966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.573596:0:7966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61066c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.573907:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976341504 00000100:00100000:0.0:1788636285.573913:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976341504 00000100:00100000:0.0:1788636285.573962:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788636285.573972:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:7966:x1875520976341504:12345-0@lo:502: 00000100:00100000:0.0:1788636285.575210:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:7966:x1875520976341504:12345-0@lo:502: Request processed in 627us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.575222:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1788636285.575341:0:7966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7966:1875520976341504:0@lo:502: 00000100:00100000:1.0:1788636285.575404:0:7966:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7966:1875520976341632:0@lo:502: 00000100:00100000:1.0:1788636285.575456:0:7966:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.575551:0:7966:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.575590:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976341632 00000100:00100000:0.0:1788636285.575724:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976341632 00000100:00100000:0.0:1788636285.576280:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788636285.576291:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+14:7966:x1875520976341632:12345-0@lo:502: 00000100:00100000:0.0:1788636285.576967:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+14:7966:x1875520976341632:12345-0@lo:502: Request processed in 674us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.576986:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788636285.577102:0:7966:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7966:1875520976341632:0@lo:502: 00000040:00080000:1.0:1788636285.577132:0:7966:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788636285.578009:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788636285.578031:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788636285.578041:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.578052:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636285.578061:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1788636285.578063:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:1.0:1788636285.578066:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788636285.578107:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.578115:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.578124:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636285.578144:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341760:0@lo:101: 00000100:00100000:1.0:1788636285.578194:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.578229:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636285.578251:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976341760 00000100:00100000:1.0:1788636285.578256:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976341760 00000100:00100000:1.0:1788636285.578302:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788636285.578311:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976341760:12345-0@lo:101: 00010000:00010000:1.0:1788636285.578327:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636285.578341:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa71bc expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.578363:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.578373:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.578380:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167c000, rc 0) 00000100:00100000:1.0:1788636285.578422:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976341760:12345-0@lo:101: Request processed in 112us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.578427:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788636285.578959:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341760:0@lo:101: 00010000:00010000:2.0:1788636285.578976:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636285.578987:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636285.579047:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341888:0@lo:501: 00000100:00100000:2.0:1788636285.579083:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636285.579115:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eebc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636285.579151:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976341888 00000100:00100000:1.0:1788636285.579156:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976341888 00000100:00100000:1.0:1788636285.579192:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788636285.579200:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976341888:12345-0@lo:501: 00000100:00100000:1.0:1788636285.579451:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976341888:12345-0@lo:501: Request processed in 250us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.579459:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788636285.580068:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976341888:0@lo:501: 00000100:00100000:2.0:1788636285.580107:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976342016:0@lo:503: 00000100:00100000:2.0:1788636285.580146:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636285.580179:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eebc00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.580326:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976342016 00000100:00100000:0.0:1788636285.580331:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976342016 00000100:00100000:0.0:1788636285.580370:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788636285.580379:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976342016:12345-0@lo:503: 00000100:00100000:0.0:1788636285.581534:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976342016:12345-0@lo:503: Request processed in 1152us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.581544:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788636285.587035:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976342016:0@lo:503: 00000100:00100000:2.0:1788636285.587523:0:7968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7968:1875520976342144:0@lo:502: 00000100:00100000:2.0:1788636285.587591:0:7968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636285.587630:0:7968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eebcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.588451:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976342144 00000100:00100000:0.0:1788636285.588460:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976342144 00000100:00100000:0.0:1788636285.588515:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788636285.588524:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:7968:x1875520976342144:12345-0@lo:502: 00000100:00100000:0.0:1788636285.590152:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:7968:x1875520976342144:12345-0@lo:502: Request processed in 1623us (2554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.590164:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788636285.590594:0:7968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a283800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7968:1875520976342144:0@lo:502: 00000020:01000000:1.0:1788636285.590627:0:7968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636285.590636:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636285.590638:0:7968:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636285.590643:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636285.590645:0:7968:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788636285.590676:0:7968:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7968:1875520976342272:0@lo:502: 00000100:00100000:1.0:1788636285.590730:0:7968:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.592418:0:7968:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.595768:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976342272 00000100:00100000:0.0:1788636285.595781:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976342272 00000100:00100000:0.0:1788636285.595849:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788636285.595858:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:7968:x1875520976342272:12345-0@lo:502: 00000100:00100000:0.0:1788636285.596706:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:7968:x1875520976342272:12345-0@lo:502: Request processed in 845us (5972us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.596715:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788636285.597932:0:7968:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7968:1875520976342272:0@lo:502: 00000020:01000000:1.0:1788636285.597988:0:7968:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636285.597996:0:7968:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636285.597998:0:7968:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788636285.598004:0:7968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1788636285.598400:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788636285.598421:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788636285.598432:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636285.598444:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636285.598454:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788636285.598457:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd613a5000 from 30 10000000:01000000:2.0:1788636285.598460:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788636285.598494:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636285.598502:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636285.598511:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636285.598529:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976342400:0@lo:101: 00000100:00100000:2.0:1788636285.598587:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636285.598631:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636285.599277:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976342400 00000100:00100000:1.0:1788636285.599285:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976342400 00000100:00100000:1.0:1788636285.599334:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1788636285.599343:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976342400:12345-0@lo:101: 00010000:00010000:1.0:1788636285.599356:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636285.599370:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa71ca expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.599392:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.599403:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636285.599412:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167d000, rc 0) 00000100:00100000:1.0:1788636285.599464:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976342400:12345-0@lo:101: Request processed in 122us (876us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.599471:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788636285.606235:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976342400:0@lo:101: 00010000:00010000:0.0:1788636285.606263:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.606294:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636285.606372:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976342528:0@lo:501: 00000100:00100000:0.0:1788636285.606431:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.606476:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd60fa16c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636285.606526:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976342528 00000100:00100000:3.0:1788636285.606533:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976342528 00000100:00100000:3.0:1788636285.606579:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788636285.606588:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976342528:12345-0@lo:501: 00000100:00100000:3.0:1788636285.606851:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976342528:12345-0@lo:501: Request processed in 264us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636285.606859:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788636285.607029:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976342528:0@lo:501: 00000100:00100000:0.0:1788636285.607057:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976342656:0@lo:503: 00000100:00100000:0.0:1788636285.607093:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.607114:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd60fa16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.607128:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976342656 00000100:00100000:0.0:1788636285.607131:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976342656 00000100:00100000:0.0:1788636285.607154:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788636285.607159:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976342656:12345-0@lo:503: 00000100:00100000:0.0:1788636285.607294:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976342656:12345-0@lo:503: Request processed in 133us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.607300:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788636285.607334:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976342656:0@lo:503: 00000100:00100000:0.0:1788636285.607540:0:7970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7970:1875520976342784:0@lo:502: 00000100:00100000:0.0:1788636285.607573:0:7970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.607590:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976342784 00000100:00100000:0.0:1788636285.607593:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976342784 00000100:00100000:0.0:1788636285.607612:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788636285.607618:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:7970:x1875520976342784:12345-0@lo:502: 00000100:00100000:0.0:1788636285.607756:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:7970:x1875520976342784:12345-0@lo:502: Request processed in 137us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.607762:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788636285.607826:0:7970:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd60fa1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.607838:0:7970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7970:1875520976342784:0@lo:502: 00000100:00100000:0.0:1788636285.607874:0:7970:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7970:1875520976342912:0@lo:502: 00000100:00100000:0.0:1788636285.607902:0:7970:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.607928:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976342912 00000100:00100000:0.0:1788636285.607932:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976342912 00000100:00100000:0.0:1788636285.607951:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788636285.607956:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:7970:x1875520976342912:12345-0@lo:502: 00000100:00100000:0.0:1788636285.608069:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:7970:x1875520976342912:12345-0@lo:502: Request processed in 111us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.608075:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788636285.608101:0:7970:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd60fa1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.608111:0:7970:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7970:1875520976342912:0@lo:502: 00000040:00080000:0.0:1788636285.608128:0:7970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788636285.608170:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788636285.608184:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788636285.608193:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608202:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636285.608210:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788636285.608220:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cfd613a5000 from 5 10000000:01000000:0.0:1788636285.608223:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788636285.608246:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608254:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608262:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636285.608274:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343040:0@lo:101: 00000100:00100000:0.0:1788636285.608299:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.608312:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc4108a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.608322:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976343040 00000100:00100000:0.0:1788636285.608326:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976343040 00000100:00100000:0.0:1788636285.608345:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788636285.608351:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976343040:12345-0@lo:101: 00010000:00010000:0.0:1788636285.608359:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636285.608373:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40031200/0xa6aa59fb12fa71df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa71d8 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608392:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40031200/0xa6aa59fb12fa71df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71d8 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608401:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40031200/0xa6aa59fb12fa71df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71d8 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608410:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031200, rc 0) 00000100:00100000:0.0:1788636285.608436:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976343040:12345-0@lo:101: Request processed in 85us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.608448:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788636285.608477:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343040:0@lo:101: 00010000:00010000:0.0:1788636285.608488:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608496:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636285.608535:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343168:0@lo:256: 00000100:00100000:0.0:1788636285.608561:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.608573:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd60fa1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.608583:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976343168 00000100:00100000:0.0:1788636285.608586:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976343168 00000100:00100000:0.0:1788636285.608604:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788636285.608609:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976343168:12345-0@lo:256: 20000000:01000000:0.0:1788636285.608620:0:5805:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788636285.608635:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788636285.608639:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1788636285.608704:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976343168:12345-0@lo:256: Request processed in 93us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.608710:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788636285.608737:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343168:0@lo:256: 10000000:01000000:0.0:1788636285.608772:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788636285.608778:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608784:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636285.608795:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1788636285.608797:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:0.0:1788636285.608799:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788636285.608832:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608838:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608845:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636285.608856:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343296:0@lo:101: 00000100:00100000:0.0:1788636285.608878:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.608889:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd60fa1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.608899:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976343296 00000100:00100000:0.0:1788636285.608902:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976343296 00000100:00100000:0.0:1788636285.608934:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788636285.608940:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976343296:12345-0@lo:101: 00010000:00010000:0.0:1788636285.608946:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636285.608954:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa71e6 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608967:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608975:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.608992:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031e00, rc 0) 00000100:00100000:0.0:1788636285.609018:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976343296:12345-0@lo:101: Request processed in 79us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.609023:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788636285.609050:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343296:0@lo:101: 00010000:00010000:0.0:1788636285.609060:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636285.609067:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636285.609103:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343424:0@lo:501: 00000100:00100000:0.0:1788636285.609126:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.609139:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd60fa1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.609149:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976343424 00000100:00100000:0.0:1788636285.609152:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976343424 00000100:00100000:0.0:1788636285.609171:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788636285.609176:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976343424:12345-0@lo:501: 00000100:00100000:0.0:1788636285.609367:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976343424:12345-0@lo:501: Request processed in 189us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.609374:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788636285.609402:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343424:0@lo:501: 00000100:00100000:0.0:1788636285.609424:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343552:0@lo:503: 00000100:00100000:0.0:1788636285.609457:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.609469:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd60fa1780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.609486:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976343552 00000100:00100000:0.0:1788636285.609489:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976343552 00000100:00100000:0.0:1788636285.609507:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788636285.609513:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976343552:12345-0@lo:503: 00000100:00100000:0.0:1788636285.609764:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976343552:12345-0@lo:503: Request processed in 250us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.609771:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788636285.609824:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976343552:0@lo:503: 00000100:00100000:0.0:1788636285.614355:0:7971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7971:1875520976343680:0@lo:502: 00000100:00100000:0.0:1788636285.614433:0:7971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.614477:0:7971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd73b02600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636285.614524:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976343680 00000100:00100000:1.0:1788636285.614531:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976343680 00000100:00100000:1.0:1788636285.614575:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788636285.614584:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:7971:x1875520976343680:12345-0@lo:502: 00000100:00100000:1.0:1788636285.615277:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:7971:x1875520976343680:12345-0@lo:502: Request processed in 691us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.615285:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788636285.615374:0:7971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7971:1875520976343680:0@lo:502: 00000020:01000000:3.0:1788636285.615402:0:7971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788636285.615410:0:7971:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788636285.615422:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636285.615424:0:7971:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788636285.615429:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788636285.615433:0:7971:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.157@tcp to nid 0x20000c0a8cb9d (192.168.203.157@tcp) 00000020:01000000:3.0:1788636285.615456:0:7971:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788636285.615459:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788636285.615481:0:7971:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cfd61340000) 00000020:00000080:3.0:1788636285.615502:0:7971:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1788636285.615508:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788636285.615572:0:7971:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788636285.615579:0:7971:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788636285.615585:0:7971:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa71fb 00010000:00080000:3.0:1788636285.615612:0:7971:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd7fd0c800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.157@tcp at head 00010000:00010000:3.0:1788636285.615934:0:7971:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1788636285.616347:0:7971:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788636285.616359:0:7971:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788636285.620562:0:7971:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636285.621976:0:7971:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636285.622045:0:7971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788636285.622112:0:7971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788636285.622764:0:7973:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636285.622769:0:7973:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788636285.625196:0:7971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636285.625209:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788636285.625243:0:7971:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788636285.625267:0:7971:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa7202 00000100:00080000:3.0:1788636285.625277:0:7971:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636285.625283:0:7971:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cfd7fd0c800 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636285.625320:0:7971:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd5d294a80 x1875520976343808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636285.625360:0:7971:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788636285.625413:0:7971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636285.625417:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636285.625419:0:7971:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788636285.625422:0:7971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636285.625425:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636285.625426:0:7971:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788636285.625429:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788636285.625431:0:7971:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788636285.625458:0:7971:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7971:1875520976343936:0@lo:502: 00000100:00100000:3.0:1788636285.625529:0:7971:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636285.625570:0:7971:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61140b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636285.625570:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976343936 00000100:00100000:0.0:1788636285.625577:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976343936 00000100:00100000:1.0:1788636285.625617:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976343808:0@lo:8: 00000100:00100000:0.0:1788636285.625618:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788636285.625626:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:7971:x1875520976343936:12345-0@lo:502: 00000100:00100000:1.0:1788636285.625651:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.625683:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976344064:0@lo:400: 00000100:00100000:1.0:1788636285.625707:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.625725:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636285.625730:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976344448:0@lo:400: 00000100:00100000:1.0:1788636285.625747:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.625774:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976343808 00000100:00100000:1.0:1788636285.625778:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976343808 00000100:00100000:1.0:1788636285.625896:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636285.625902:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3279:x1875520976343808:12345-0@lo:8: 00010000:00080000:1.0:1788636285.625936:0:6963:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:1.0:1788636285.625959:0:6963:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa7209 00002000:00100000:1.0:1788636285.625972:0:6963:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cfd613be000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788636285.625976:0:6963:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:1.0:1788636285.625980:0:6963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1788636285.626088:0:6963:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788636285.626223:0:6963:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788636285.626244:0:6963:0:(import.c:65:import_set_state_nolock()) ffff9cfd613b8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636285.626284:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3279:x1875520976343808:12345-0@lo:8: Request processed in 381us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.626292:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636285.626313:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976344064 00000100:00100000:1.0:1788636285.626322:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976344064 00000100:00100000:1.0:1788636285.626349:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976344448 00000100:00100000:1.0:1788636285.626352:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976344448 00000100:00100000:1.0:1788636285.626366:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636285.626372:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976344064:12345-0@lo:400: 00000100:00100000:1.0:1788636285.626407:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976344064:12345-0@lo:400: Request processed in 35us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.626413:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788636285.626424:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636285.626430:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976344448:12345-0@lo:400: 00000100:00100000:1.0:1788636285.626454:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976344448:12345-0@lo:400: Request processed in 25us (705us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.626460:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788636285.626498:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd5d294a80 x1875520976343808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636295 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636285.626507:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636285.626514:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788636285.626520:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788636285.626524:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788636285.626527:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fd0c800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788636285.626539:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788636285.626543:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976343808:0@lo:8: 00010000:00080000:1.0:1788636285.626567:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd756a7100 x1875520976344448/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636285.626576:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976344448:0@lo:400: 00010000:00080000:1.0:1788636285.626584:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd756a5500 x1875520976344064/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636285.626598:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976344064:0@lo:400: 00000004:00080000:1.0:1788636285.626616:0:7973:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788636285.626696:0:7973:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 154650899830ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788636285.626890:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:7971:x1875520976343936:12345-0@lo:502: Request processed in 1263us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.626897:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788636285.627031:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976344192:0@lo:400: 00000100:00100000:2.0:1788636285.627063:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636285.627088:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636285.627094:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976344320:0@lo:400: 00000100:00100000:2.0:1788636285.627115:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636285.627142:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976344192 00000100:00100000:2.0:1788636285.627146:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976344192 00000100:00100000:2.0:1788636285.627168:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788636285.627172:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788636285.627175:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976344192:12345-0@lo:400: 00000100:00100000:0.0:1788636285.627179:0:5811:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788636285.627216:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976344192:12345-0@lo:400: Request processed in 42us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636285.627222:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636285.627240:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976344320 00000100:00100000:2.0:1788636285.627243:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976344320 00000100:00100000:2.0:1788636285.627266:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636285.627273:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976344320:12345-0@lo:400: 00000100:00100000:2.0:1788636285.627300:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976344320:12345-0@lo:400: Request processed in 29us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636285.627306:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788636285.627423:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd756a5f80 x1875520976344320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636285.627433:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976344320:0@lo:400: 00010000:00080000:0.0:1788636285.627442:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd756a5c00 x1875520976344192/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636301 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636285.627449:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976344192:0@lo:400: 00000100:00100000:3.0:1788636285.632238:0:7971:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:7971:1875520976343936:0@lo:502: 00000020:01000000:3.0:1788636285.632279:0:7971:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636285.632287:0:7971:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636285.632289:0:7971:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788636285.632294:0:7971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1788636285.632352:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1788636285.632369:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788636285.632379:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636285.632390:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636285.632399:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788636285.632402:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cfd5d20cd40 from 1 10000000:01000000:3.0:1788636285.632405:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788636285.632436:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636285.632450:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636285.632459:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636285.632477:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976344576:0@lo:101: 00000100:00100000:3.0:1788636285.632530:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636285.632564:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd58773d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636285.632579:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976344576 00000100:00100000:3.0:1788636285.632585:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976344576 00000100:00100000:3.0:1788636285.632620:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636285.632628:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976344576:12345-0@lo:101: 00010000:00010000:3.0:1788636285.632639:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636285.632652:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7210 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636285.632674:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636285.632683:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636285.632689:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c800, rc 0) 00000100:00100000:3.0:1788636285.632724:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976344576:12345-0@lo:101: Request processed in 97us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636285.632730:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636285.632764:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976344576:0@lo:101: 00010000:00010000:3.0:1788636285.632782:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636285.632791:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636285.637973:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976344704:0@lo:501: 00000100:00100000:3.0:1788636285.638041:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636285.638085:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd58773d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636285.638107:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976344704 00000100:00100000:3.0:1788636285.638112:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976344704 00000100:00100000:3.0:1788636285.638148:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788636285.638157:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976344704:12345-0@lo:501: 00000100:00100000:3.0:1788636285.638363:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976344704:12345-0@lo:501: Request processed in 206us (321us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636285.638371:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788636285.638414:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976344704:0@lo:501: 10000000:01000000:3.0:1788636285.638441:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788636285.638450:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636285.638461:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636285.707502:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788636285.774643:0:7974:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1788636285.774683:0:7974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7974:1875520976344960:0@lo:7: 00000100:00100000:1.0:1788636285.774757:0:7974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.774822:0:7974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636285.774852:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976344832:0@lo:13: 00000100:00100000:1.0:1788636285.775176:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636285.775235:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976344960 00000100:00100000:1.0:1788636285.775244:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976344960 00000100:00100000:1.0:1788636285.775302:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636285.775312:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7974:x1875520976344960:12345-0@lo:7: 00000100:00100000:0.0:1788636285.780263:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976344832 00000100:00100000:0.0:1788636285.780276:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976344832 00000100:00100000:0.0:1788636285.780356:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788636285.780367:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875520976344832:12345-0@lo:13: 00002000:00000024:0.0:1788636285.780399:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788636285.780479:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875520976344832:12345-0@lo:13: Request processed in 114us (5302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.780486:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788636285.780985:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788636285.782909:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd76a3b480 x1875520976344832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636285.782942:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976344832:0@lo:13: 00002000:00080000:1.0:1788636285.791573:0:6963:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1788636285.791583:0:6963:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1788636285.793068:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:7974:x1875520976344960:12345-0@lo:7: Request processed in 17750us (18303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636285.793092:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788636285.799216:0:7974:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd76a39c00 x1875520976344960/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788636301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636285.799236:0:7974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7974:1875520976344960:0@lo:7: 00000004:00080000:0.0:1788636285.799251:0:7974:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1788636285.799291:0:7974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7974:1875520976345088:0@lo:5: 00000100:00100000:0.0:1788636285.799354:0:7974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.799401:0:7974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636285.800296:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976345088 00000100:00100000:2.0:1788636285.800308:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976345088 00000100:00100000:2.0:1788636285.800369:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636285.800378:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7974:x1875520976345088:12345-0@lo:5: 00002000:00080000:2.0:1788636285.800409:0:6661:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788636285.800429:0:6661:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788636285.800786:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7974:x1875520976345088:12345-0@lo:5: Request processed in 408us (1430us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788636285.800811:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788636285.801219:0:7974:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd756a5c00 x1875520976345088/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636285.801236:0:7974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7974:1875520976345088:0@lo:5: 00000004:00080000:0.0:1788636285.801249:0:7974:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788636285.801287:0:7974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7974:1875520976345216:0@lo:700: 00000100:00100000:0.0:1788636285.801331:0:7974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636285.801359:0:7974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636285.803926:0:6668:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976345216 00000100:00100000:2.0:1788636285.803939:0:6668:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976345216 00000100:00100000:2.0:1788636285.803992:0:6668:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636285.804002:0:6668:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7974:x1875520976345216:12345-0@lo:700: 00000100:00100000:2.0:1788636285.804066:0:6668:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6668:1875520976345344:0@lo:700: 00000100:00100000:2.0:1788636285.804216:0:6668:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636285.804241:0:6668:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eeb780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636285.804258:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976345344 00000100:00100000:2.0:1788636285.804262:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976345344 00000100:00100000:2.0:1788636285.804295:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636285.804303:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6668:x1875520976345344:12345-0@lo:700: 40000000:02000000:0.0:1788636285.866566:0:5817:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1788636285.877687:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6668:x1875520976345344:12345-0@lo:700: Request processed in 73376us (73462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.877723:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788636285.877860:0:6668:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a281880 x1875520976345344/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788636301 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636285.877875:0:6668:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6668:1875520976345344:0@lo:700: 40000000:02000000:1.0:1788636285.877888:0:6668:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:0.0:1788636285.961909:0:6668:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7974:x1875520976345216:12345-0@lo:700: Request processed in 157899us (160568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636285.961937:0:6668:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788636285.961991:0:7974:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd756a4a80 x1875520976345216/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788636301 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636285.962006:0:7974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7974:1875520976345216:0@lo:700: 00000001:00100000:1.0:1788636285.963042:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788636285.963053:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000004:02000040:0.0:1788636286.007463:0:7974:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788636286.023291:0:7974:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7974:1875520976345472:0@lo:5: 00000100:00100000:0.0:1788636286.023380:0:7974:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636286.023448:0:7974:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636286.023563:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976345472 00000100:00100000:1.0:1788636286.023587:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976345472 00000100:00100000:1.0:1788636286.023655:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636286.023667:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7974:x1875520976345472:12345-0@lo:5: 00002000:00080000:1.0:1788636286.033446:0:6662:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788636286.033476:0:6662:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1788636286.040754:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7974:x1875520976345472:12345-0@lo:5: Request processed in 17081us (17364us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1788636286.040769:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788636286.041190:0:7974:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd756a4a80 x1875520976345472/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636302 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636286.041206:0:7974:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788636286.041227:0:7974:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cfd756a4a80 x1875520976345472/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788636302 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636286.041241:0:7974:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7974:1875520976345472:0@lo:5: 00000004:00080000:1.0:1788636286.041259:0:7974:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788636286.531923:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636287.552283:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636287.617067:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636287.617106:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976345600:0@lo:13: 00000100:00100000:2.0:1788636287.617214:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636287.617279:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976345600 00000100:00100000:1.0:1788636287.617290:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976345600 00000100:00080000:2.0:1788636287.617338:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636287.617364:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636287.617377:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976345600:12345-0@lo:13: 00002000:00000024:1.0:1788636287.617435:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636287.617502:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976345600:12345-0@lo:13: Request processed in 128us (288us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636287.617511:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788636287.617547:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd5d295c00 x1875520976345600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636303 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636287.617571:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976345600:0@lo:13: 00010000:00010000:2.0:1788636288.581907:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636289.598912:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636290.625046:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636290.688511:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976345856:0@lo:400: 00000100:00100000:2.0:1788636290.688578:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636290.688630:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976346368:0@lo:400: 00000100:00100000:2.0:1788636290.688657:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636290.688694:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636290.688701:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976345984:0@lo:400: 00000100:00100000:2.0:1788636290.688736:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636290.688765:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976345856 00000100:00100000:2.0:1788636290.688773:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976345856 00000100:00100000:2.0:1788636290.688984:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976345984 00000100:00100000:2.0:1788636290.688988:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976345984 00000100:00100000:2.0:1788636290.689018:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636290.689027:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976345856:12345-0@lo:400: 00000100:00100000:2.0:1788636290.689080:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976345856:12345-0@lo:400: Request processed in 54us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636290.689088:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636290.689115:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788636290.689122:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976345984:12345-0@lo:400: 00000100:00100000:2.0:1788636290.689150:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976345984:12345-0@lo:400: Request processed in 29us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636290.689156:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788636290.689175:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976346368 00000100:00100000:2.0:1788636290.689178:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976346368 00000100:00100000:2.0:1788636290.689203:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636290.689209:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976346368:12345-0@lo:400: 00000100:00100000:0.0:1788636290.689330:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976346112:0@lo:400: 00000100:00100000:0.0:1788636290.689362:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636290.689387:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788636290.689392:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976345728:0@lo:400: 00000100:00100000:0.0:1788636290.689442:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636290.689467:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976346240:0@lo:400: 00000100:00100000:0.0:1788636290.689516:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636290.689548:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976346112 00000100:00100000:0.0:1788636290.689551:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976346112 00000100:00100000:0.0:1788636290.689579:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636290.689585:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976346112:12345-0@lo:400: 00000100:00100000:0.0:1788636290.689617:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976346112:12345-0@lo:400: Request processed in 33us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636290.689624:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636290.689645:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976345728 00000100:00100000:0.0:1788636290.689649:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976345728 00000100:00100000:0.0:1788636290.689671:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788636290.689677:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976345728:12345-0@lo:400: 00000100:00100000:0.0:1788636290.689703:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976345728:12345-0@lo:400: Request processed in 27us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636290.689709:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788636290.689761:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976345728:0@lo:400: 00010000:00080000:0.0:1788636290.689775:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5d9500 x1875520976346112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636290.689787:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976346112:0@lo:400: 00000100:00100000:0.0:1788636290.689839:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976346240 00000100:00100000:0.0:1788636290.689842:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976346240 00000100:00100000:0.0:1788636290.689861:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636290.689868:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875520976346240:12345-0@lo:400: 00000100:00100000:0.0:1788636290.689911:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875520976346240:12345-0@lo:400: Request processed in 43us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636290.689923:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788636290.689953:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5d9880 x1875520976346240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636290.689963:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976346240:0@lo:400: 00000100:00100000:2.0:1788636290.690891:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976346368:12345-0@lo:400: Request processed in 1670us (2221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636290.690900:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788636290.690936:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636290.690941:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636290.690944:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788636290.690973:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a281880 x1875520976345984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636290.690994:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976345984:0@lo:400: 00010000:00080000:2.0:1788636290.691008:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a281f80 x1875520976345856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636290.691016:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976345856:0@lo:400: 00010000:00080000:2.0:1788636290.691025:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5dbb80 x1875520976346368/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636306 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636290.691033:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976346368:0@lo:400: 00000001:00080000:1.0:1788636290.748545:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1788636291.199349:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636291.199389:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976346496:0@lo:13: 00000100:00100000:3.0:1788636291.199493:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636291.199680:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976346496 00000100:00100000:2.0:1788636291.199693:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976346496 00000100:00100000:2.0:1788636291.199748:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636291.199757:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976346496:12345-0@lo:13: 00002000:00000024:2.0:1788636291.199791:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636291.199904:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d296a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976346496:12345-0@lo:13: Request processed in 148us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636291.199911:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788636291.200340:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5dbb80 x1875520976346496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636307 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636291.200354:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788636291.200385:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976346496:0@lo:13: 00000100:00100000:1.0:1788636291.231577:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636291.231663:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963739776 00000100:00100000:3.0:1788636291.231672:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963739776 00000100:00100000:3.0:1788636291.231753:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 111 00000100:00100000:3.0:1788636291.231761:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2359:x1875520963739776:12345-192.168.203.57@tcp:250: 00010000:00080000:3.0:1788636291.231788:0:5805:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 003dba47-3849-46de-b5b5-7b33358ec353@192.168.203.57@tcp t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:3.0:1788636291.231845:0:5805:0:(genops.c:1385:class_connect()) connect: client 003dba47-3849-46de-b5b5-7b33358ec353, cookie 0xa6aa59fb12fa721e 00000100:00080000:3.0:1788636291.232098:0:5805:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a34000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636291.232163:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+5:2359:x1875520963739776:12345-192.168.203.57@tcp:250: Request processed in 401us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636291.232170:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 111 00000100:00100000:3.0:1788636291.234345:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636291.235336:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963739904 00000100:00100000:0.0:1788636291.235355:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963739904 00000100:00100000:0.0:1788636291.235432:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 112 00000100:00100000:0.0:1788636291.235444:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+5:5586:x1875520963739904:12345-192.168.203.57@tcp:101: 00010000:00010000:0.0:1788636291.235465:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636291.235489:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351553fb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.235527:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.235541:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.235552:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031600, rc 0) 00000100:00100000:0.0:1788636291.235630:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+6:5586:x1875520963739904:12345-192.168.203.57@tcp:101: Request processed in 188us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636291.235638:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 112 00000100:00100000:1.0:1788636291.271283:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636291.274721:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963740032 00000100:00100000:3.0:1788636291.274735:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963740032 00000100:00100000:3.0:1788636291.274833:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 113 00000100:00100000:3.0:1788636291.274844:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+6:5586:x1875520963740032:12345-192.168.203.57@tcp:501: 00000100:00100000:3.0:1788636291.275132:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+6:5586:x1875520963740032:12345-192.168.203.57@tcp:501: Request processed in 289us (3857us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636291.275140:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 113 00000100:00100000:1.0:1788636291.280247:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636291.280469:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963740160 00000100:00100000:0.0:1788636291.280479:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963740160 00000100:00100000:0.0:1788636291.280527:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 114 00000100:00100000:0.0:1788636291.280537:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+6:5586:x1875520963740160:12345-192.168.203.57@tcp:101: 00010000:00010000:0.0:1788636291.280563:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636291.280583:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155402 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.280611:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.280623:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.280632:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031000, rc 0) 00000100:00100000:0.0:1788636291.280686:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+7:5586:x1875520963740160:12345-192.168.203.57@tcp:101: Request processed in 151us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636291.280693:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 114 00000100:00100000:0.0:1788636291.284447:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636291.284577:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963740288 00000100:00100000:1.0:1788636291.284587:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963740288 00000100:00100000:1.0:1788636291.284651:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 115 00000100:00100000:1.0:1788636291.284661:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+7:5586:x1875520963740288:12345-192.168.203.57@tcp:501: 00000100:00100000:1.0:1788636291.284924:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+8:5586:x1875520963740288:12345-192.168.203.57@tcp:501: Request processed in 264us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636291.284932:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 115 00000100:00100000:3.0:1788636291.287378:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636291.287555:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963740416 00000100:00100000:0.0:1788636291.287563:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963740416 00000100:00100000:0.0:1788636291.287615:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 116 00000100:00100000:0.0:1788636291.287648:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+8:5586:x1875520963740416:12345-192.168.203.57@tcp:503: 00000100:00100000:0.0:1788636291.287911:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+8:5586:x1875520963740416:12345-192.168.203.57@tcp:503: Request processed in 287us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636291.287920:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 116 00000100:00100000:1.0:1788636291.302948:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636291.303059:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963740544 00000100:00100000:0.0:1788636291.303069:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963740544 00000100:00100000:0.0:1788636291.303126:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 117 00000100:00100000:0.0:1788636291.303138:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+8:5605:x1875520963740544:12345-192.168.203.57@tcp:502: 00000100:00100000:0.0:1788636291.303676:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+8:5605:x1875520963740544:12345-192.168.203.57@tcp:502: Request processed in 540us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636291.303691:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 117 00000100:00100000:3.0:1788636291.340980:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636291.341103:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963740672 00000100:00100000:1.0:1788636291.341113:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963740672 00000100:00100000:1.0:1788636291.341166:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 118 00000100:00100000:1.0:1788636291.341176:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+8:5605:x1875520963740672:12345-192.168.203.57@tcp:502: 00000100:00100000:1.0:1788636291.341637:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+8:5605:x1875520963740672:12345-192.168.203.57@tcp:502: Request processed in 461us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636291.341645:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 118 00000100:00100000:1.0:1788636291.352562:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636291.352637:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963740800 00000100:00100000:0.0:1788636291.352646:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963740800 00000100:00100000:0.0:1788636291.352697:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 119 00000100:00100000:0.0:1788636291.352707:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+8:5586:x1875520963740800:12345-192.168.203.57@tcp:101: 00010000:00010000:0.0:1788636291.352733:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636291.352751:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7233 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb98284483515542c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.352778:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515542c expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.352790:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7233 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515542c expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636291.352817:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031c00, rc 0) 00000100:00100000:0.0:1788636291.352869:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+9:5586:x1875520963740800:12345-192.168.203.57@tcp:101: Request processed in 163us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636291.352885:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 119 00000100:00100000:2.0:1788636291.361939:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636291.361973:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963740928 00000100:00100000:2.0:1788636291.361982:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963740928 00000100:00100000:2.0:1788636291.362135:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 120 00000100:00100000:2.0:1788636291.362144:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+9:5586:x1875520963740928:12345-192.168.203.57@tcp:256: 20000000:01000000:2.0:1788636291.362165:0:5805:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788636291.362182:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788636291.362187:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788636291.362190:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788636291.362193:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788636291.366775:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+9:5586:x1875520963740928:12345-192.168.203.57@tcp:256: Request processed in 4622us (4835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636291.366789:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 120 00000100:00100000:2.0:1788636291.371210:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636291.371288:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963741056 00000100:00100000:1.0:1788636291.371298:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963741056 00000100:00100000:1.0:1788636291.371350:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 121 00000100:00100000:1.0:1788636291.371681:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+9:5586:x1875520963741056:12345-192.168.203.57@tcp:101: 00010000:00010000:1.0:1788636291.371698:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636291.371908:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155433 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636291.371939:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636291.371951:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636291.371977:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167c800, rc 0) 00000100:00100000:1.0:1788636291.372172:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:5586:x1875520963741056:12345-192.168.203.57@tcp:101: Request processed in 811us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636291.372179:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 121 00000100:00100000:1.0:1788636291.383576:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636291.383655:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963741184 00000100:00100000:3.0:1788636291.383666:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963741184 00000100:00100000:3.0:1788636291.384522:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 122 00000100:00100000:3.0:1788636291.384535:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:5586:x1875520963741184:12345-192.168.203.57@tcp:501: 00000100:00100000:3.0:1788636291.384975:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:5586:x1875520963741184:12345-192.168.203.57@tcp:501: Request processed in 442us (1407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636291.384984:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 122 00000100:00100000:2.0:1788636291.388791:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636291.388895:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963741312 00000100:00100000:3.0:1788636291.388904:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963741312 00000100:00100000:3.0:1788636291.388958:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 123 00000100:00100000:3.0:1788636291.388967:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:5586:x1875520963741312:12345-192.168.203.57@tcp:503: 00000100:00100000:3.0:1788636291.389297:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:5586:x1875520963741312:12345-192.168.203.57@tcp:503: Request processed in 330us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636291.389305:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 123 00000100:00100000:0.0:1788636291.392589:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636291.392672:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963741440 00000100:00100000:1.0:1788636291.392682:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963741440 00000100:00100000:1.0:1788636291.392746:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 124 00000100:00100000:1.0:1788636291.392756:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:5610:x1875520963741440:12345-192.168.203.57@tcp:502: 00000100:00100000:1.0:1788636291.393036:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:5610:x1875520963741440:12345-192.168.203.57@tcp:502: Request processed in 280us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636291.393045:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 124 00000100:00100000:2.0:1788636291.399524:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636291.399605:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963741568 00000100:00100000:0.0:1788636291.399614:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963741568 00000100:00100000:0.0:1788636291.399664:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 125 00000100:00100000:0.0:1788636291.399674:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:5610:x1875520963741568:12345-192.168.203.57@tcp:502: 00000100:00100000:0.0:1788636291.400102:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:5610:x1875520963741568:12345-192.168.203.57@tcp:502: Request processed in 428us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636291.400110:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 125 00000100:00100000:2.0:1788636291.406178:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636291.406213:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963741696 00000100:00100000:2.0:1788636291.406222:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963741696 00000100:00100000:2.0:1788636291.406259:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:2.0:1788636291.406268:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1875520963741696:12345-192.168.203.57@tcp:38: 00010000:00080000:2.0:1788636291.406297:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp t0 exp 0000000000000000 cur 160 last 0 00000020:00000080:2.0:1788636291.406342:0:5810:0:(genops.c:1385:class_connect()) connect: client 38630149-ece4-4de3-88b1-a62e16a39489, cookie 0xa6aa59fb12fa7241 00000004:00100000:2.0:1788636291.406490:0:5810:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788636291.406498:0:5810:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788636291.444635:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fe79000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636291.445015:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2359:x1875520963741696:12345-192.168.203.57@tcp:38: Request processed in 38742us (38842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636291.445028:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 4 00010000:00010000:0.0:1788636291.647150:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636292.472588:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636292.472634:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636292.472716:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963741952 00000100:00100000:2.0:1788636292.472725:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963741952 00000100:00100000:2.0:1788636292.472823:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963741824 00000100:00100000:2.0:1788636292.472827:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963741824 00000100:00100000:2.0:1788636292.472860:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:2.0:1788636292.472879:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:5586:x1875520963741952:12345-192.168.203.57@tcp:41: 00000004:00000024:2.0:1788636292.472925:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1788636292.472989:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:2.0:1788636292.472999:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:5586:x1875520963741952:12345-192.168.203.57@tcp:41: Request processed in 128us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636292.473003:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+7:0:x1875520963741824:12345-192.168.203.57@tcp:41: 00000004:00000024:1.0:1788636292.473019:0:7975:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788636292.473025:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:1.0:1788636292.473053:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:0:x1875520963741824:12345-192.168.203.57@tcp:41: Request processed in 54us (417us total) trans 0 rc 0/0 00000100:00080000:3.0:1788636292.473233:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636292.473351:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:1.0:1788636292.478925:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636292.479982:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963742080 00000100:00100000:2.0:1788636292.479994:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963742080 00000100:00100000:2.0:1788636292.480061:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:2.0:1788636292.480072:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:5586:x1875520963742080:12345-192.168.203.57@tcp:40: 00000100:00100000:2.0:1788636292.480927:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:5586:x1875520963742080:12345-192.168.203.57@tcp:40: Request processed in 852us (2006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636292.480939:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:2.0:1788636292.492328:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636292.492375:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636292.492462:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963742464 00000100:00100000:3.0:1788636292.492471:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963742464 00000100:00100000:3.0:1788636292.492539:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:3.0:1788636292.492550:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:5586:x1875520963742464:12345-192.168.203.57@tcp:33: 00000100:00100000:1.0:1788636292.494228:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636292.494265:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636292.494330:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963742208 00000100:00100000:2.0:1788636292.494338:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963742208 00000100:00100000:2.0:1788636292.494384:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963742336 00000100:00100000:2.0:1788636292.494388:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963742336 00000100:00100000:2.0:1788636292.494407:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:2.0:1788636292.494414:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1875520963742208:12345-192.168.203.57@tcp:8: 00010000:00080000:2.0:1788636292.494442:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1788636292.494473:0:6659:0:(genops.c:1385:class_connect()) connect: client 38630149-ece4-4de3-88b1-a62e16a39489, cookie 0xa6aa59fb12fa7248 00002000:00100000:2.0:1788636292.494483:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 38630149-ece4-4de3-88b1-a62e16a39489/ffff9cfd7a53a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788636292.494516:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788636292.494881:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788636292.494914:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9cfd7a53b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636292.494973:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2359:x1875520963742208:12345-192.168.203.57@tcp:8: Request processed in 558us (752us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636292.494981:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:2.0:1788636292.495011:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:2.0:1788636292.495017:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1875520963742336:12345-192.168.203.57@tcp:8: 00010000:00080000:2.0:1788636292.495032:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:2.0:1788636292.495047:0:6659:0:(genops.c:1385:class_connect()) connect: client 38630149-ece4-4de3-88b1-a62e16a39489, cookie 0xa6aa59fb12fa724f 00002000:00100000:2.0:1788636292.495052:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 38630149-ece4-4de3-88b1-a62e16a39489/ffff9cfd47fc3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788636292.495058:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788636292.495257:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788636292.495273:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9cfd47fc0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636292.495297:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2359:x1875520963742336:12345-192.168.203.57@tcp:8: Request processed in 278us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636292.495303:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:0.0:1788636292.496480:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963742592 00000100:00100000:0.0:1788636292.496492:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963742592 00000100:00100000:0.0:1788636292.496563:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 126 00000100:00100000:0.0:1788636292.496573:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:2360:x1875520963742592:12345-192.168.203.57@tcp:400: 00000100:00100000:0.0:1788636292.496628:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:2360:x1875520963742592:12345-192.168.203.57@tcp:400: Request processed in 57us (4254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636292.496635:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 126 00000004:00080000:3.0:1788636292.530646:0:5813:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37918us 00000004:00200000:2.0:1788636292.558198:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788636292.558318:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:5586:x1875520963742464:12345-192.168.203.57@tcp:33: Request processed in 65765us (65993us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636292.558334:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00010000:00010000:1.0:1788636292.671756:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636292.739099:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976346624:0@lo:13: 00000100:00100000:0.0:1788636292.739174:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636292.739389:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976346624 00000100:00100000:2.0:1788636292.739397:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976346624 00000100:00100000:2.0:1788636292.739466:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636292.739476:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976346624:12345-0@lo:13: 00002000:00000024:2.0:1788636292.739498:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788636292.739564:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636292.751463:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976346624:12345-0@lo:13: Request processed in 11975us (12274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636292.751478:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788636292.751594:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd5d296680 x1875520976346624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636308 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636292.751624:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976346624:0@lo:13: 00000100:00100000:1.0:1788636292.834231:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636292.834585:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963742720 00000100:00100000:0.0:1788636292.834596:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963742720 00000100:00100000:0.0:1788636292.834657:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:0.0:1788636292.834668:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:5627:x1875520963742720:12345-192.168.203.57@tcp:101: 00010000:00010000:0.0:1788636292.834688:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636292.835170:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa7256 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515545d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636292.835236:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa725d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636292.835650:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa725d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636292.835678:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa725d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636292.835711:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788636292.835714:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636292.835730:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa725d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636292.835763:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa7256 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515545d expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636292.835786:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa725d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515545d expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636292.835832:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500ebe00) 00010000:00010000:0.0:1788636292.835836:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636292.835839:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd820fc000, rc 0) 00000100:00100000:0.0:1788636292.835918:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:5627:x1875520963742720:12345-192.168.203.57@tcp:101: Request processed in 1252us (1696us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636292.835926:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00010000:00010000:0.0:1788636293.695249:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788636293.847753:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00010000:00010000:1.0:1788636294.720488:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636295.089752:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636295.089986:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963742848 00000100:00100000:2.0:1788636295.089995:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963742848 00000100:00080000:3.0:1788636295.090060:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636295.090079:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:2.0:1788636295.090102:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:5679:x1875520963742848:12345-192.168.203.57@tcp:41: 00000004:00000024:2.0:1788636295.090146:0:5810:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788636295.090226:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:5679:x1875520963742848:12345-192.168.203.57@tcp:41: Request processed in 125us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636295.090233:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:1.0:1788636295.093617:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636295.093789:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963742976 00000100:00100000:3.0:1788636295.093831:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963742976 00000100:00100000:3.0:1788636295.094329:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:3.0:1788636295.094344:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:38630149-ece4-4de3-88b1-a62e16a39489+5:5679:x1875520963742976:12345-192.168.203.57@tcp:13: 00002000:00000024:3.0:1788636295.094392:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636295.094492:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:38630149-ece4-4de3-88b1-a62e16a39489+5:5679:x1875520963742976:12345-192.168.203.57@tcp:13: Request processed in 152us (889us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636295.094501:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00080000:2.0:1788636295.095236:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636295.097589:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636295.097841:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963743104 00000100:00100000:0.0:1788636295.097868:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963743104 00000100:00100000:0.0:1788636295.098101:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:0.0:1788636295.098114:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:38630149-ece4-4de3-88b1-a62e16a39489+6:5679:x1875520963743104:12345-192.168.203.57@tcp:13: 00002000:00000024:0.0:1788636295.098168:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788636295.098680:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636295.098771:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:38630149-ece4-4de3-88b1-a62e16a39489+6:5679:x1875520963743104:12345-192.168.203.57@tcp:13: Request processed in 648us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636295.098838:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00010000:00010000:1.0:1788636295.744183:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636295.808045:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976346880:0@lo:400: 00000100:00100000:0.0:1788636295.808045:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976347008:0@lo:400: 00000100:00100000:2.0:1788636295.808102:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976347136:0@lo:400: 00000100:00100000:1.0:1788636295.808103:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976346752:0@lo:400: 00000100:00100000:3.0:1788636295.817924:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636295.818007:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976347392:0@lo:400: 00000100:00100000:3.0:1788636295.818044:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636295.819265:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976347392 00000100:00100000:3.0:1788636295.819277:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976347392 00000100:00100000:3.0:1788636295.819345:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636295.819354:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976347392:12345-0@lo:400: 00000100:00100000:3.0:1788636295.819427:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d296680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976347392:12345-0@lo:400: Request processed in 73us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636295.819435:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1788636295.819482:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75cfdf80 x1875520976347392/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636295.819497:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976347392:0@lo:400: 00000100:00100000:0.0:1788636295.819771:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636295.819895:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976346880 00000100:00100000:0.0:1788636295.819901:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976346880 00000100:00100000:0.0:1788636295.819935:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976347008 00000100:00100000:0.0:1788636295.819938:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976347008 00000100:00100000:0.0:1788636295.820043:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636295.820051:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976346880:12345-0@lo:400: 00000100:00100000:0.0:1788636295.820095:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976346880:12345-0@lo:400: Request processed in 44us (2178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636295.820101:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636295.820115:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636295.820122:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875520976347008:12345-0@lo:400: 00000100:00100000:0.0:1788636295.820157:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875520976347008:12345-0@lo:400: Request processed in 36us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636295.820163:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636295.820194:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976346880:0@lo:400: 00000100:00100000:0.0:1788636295.820219:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976347008:0@lo:400: 00000100:00100000:2.0:1788636295.820492:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788636295.820540:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636295.820545:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636295.820554:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976347136 00000100:00100000:2.0:1788636295.820558:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976347136 00000100:00100000:2.0:1788636295.820590:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636295.820597:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976347136:12345-0@lo:400: 00000100:00100000:2.0:1788636295.820647:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976347136:12345-0@lo:400: Request processed in 51us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636295.820653:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788636295.820777:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636295.820840:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75cfe680 x1875520976347136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636311 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636295.820862:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976347136:0@lo:400: 00000100:00100000:1.0:1788636295.821926:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636295.822070:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976347264:0@lo:400: 00000100:00100000:1.0:1788636295.822105:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636295.822280:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976347264 00000100:00100000:2.0:1788636295.822289:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976347264 00000100:00100000:2.0:1788636295.822393:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788636295.822402:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976347264:12345-0@lo:400: 00000100:00100000:2.0:1788636295.822453:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976347264:12345-0@lo:400: Request processed in 53us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636295.822470:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788636295.822550:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976347264:0@lo:400: 00000100:00100000:0.0:1788636295.823833:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976346752 00000100:00100000:0.0:1788636295.823845:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976346752 00000100:00100000:0.0:1788636295.824109:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788636295.824233:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976346752:12345-0@lo:400: 00000100:00100000:0.0:1788636295.824310:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976346752:12345-0@lo:400: Request processed in 81us (2386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636295.824329:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788636295.824366:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976346752:0@lo:400: 00000100:00080000:3.0:1788636295.824549:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636296.319192:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636296.319218:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976347520:0@lo:13: 00000100:00100000:1.0:1788636296.319297:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636296.319438:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976347520 00000100:00100000:2.0:1788636296.319445:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976347520 00000100:00100000:2.0:1788636296.319501:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636296.319512:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976347520:12345-0@lo:13: 00002000:00000024:2.0:1788636296.319536:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636296.319594:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976347520:12345-0@lo:13: Request processed in 84us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636296.319602:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788636296.319763:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5d9180 x1875520976347520/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636312 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636296.319782:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976347520:0@lo:13: 00010000:00010000:1.0:1788636296.767221:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788636296.869482:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000001:00100000:3.0:1788636296.873398:0:5832:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00010000:00010000:1.0:1788636297.792030:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788636297.793270:0:8279:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788636297.800120:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636297.800636:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636297.800676:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636297.800699:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636297.800729:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963743616 00000100:00100000:3.0:1788636297.800745:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963743616 00000100:00100000:3.0:1788636297.800848:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963743488 00000100:00100000:3.0:1788636297.800852:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963743488 00000100:00100000:3.0:1788636297.800878:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:3.0:1788636297.800888:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963743616:12345-192.168.203.57@tcp:400: 00000100:00100000:3.0:1788636297.800957:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963743616:12345-192.168.203.57@tcp:400: Request processed in 71us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636297.800964:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:3.0:1788636297.800978:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:3.0:1788636297.800985:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963743488:12345-192.168.203.57@tcp:400: 00000100:00100000:3.0:1788636297.801009:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963743488:12345-192.168.203.57@tcp:400: Request processed in 25us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636297.801016:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00080000:3.0:1788636297.801032:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636297.801036:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636297.801355:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963743232 00000100:00100000:1.0:1788636297.801361:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963743232 00000100:00100000:1.0:1788636297.801397:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 128 00000100:00100000:1.0:1788636297.801406:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963743232:12345-192.168.203.57@tcp:400: 00000100:00100000:1.0:1788636297.801441:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963743232:12345-192.168.203.57@tcp:400: Request processed in 36us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636297.801448:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 128 00000100:00100000:0.0:1788636297.801787:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963743360 00000100:00100000:0.0:1788636297.801791:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963743360 00000100:00100000:0.0:1788636297.802158:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:0.0:1788636297.802167:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963743360:12345-192.168.203.57@tcp:400: 00000100:00100000:0.0:1788636297.802214:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963743360:12345-192.168.203.57@tcp:400: Request processed in 48us (2104us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636297.802221:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00080000:3.0:1788636297.802500:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636297.866440:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636297.866471:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976347648:0@lo:13: 00000100:00100000:1.0:1788636297.866580:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636297.866897:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976347648 00000100:00100000:3.0:1788636297.866904:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976347648 00000100:00100000:3.0:1788636297.866967:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636297.866976:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976347648:12345-0@lo:13: 00002000:00000024:3.0:1788636297.867009:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636297.867057:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976347648:12345-0@lo:13: Request processed in 82us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636297.867063:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788636297.867104:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd5d294380 x1875520976347648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636313 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636297.867126:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976347648:0@lo:13: 00000100:00080000:1.0:1788636297.867184:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788636298.815954:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636299.840854:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636300.864032:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636300.927187:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976347776:0@lo:400: 00000100:00100000:0.0:1788636300.927253:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636300.927299:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976348288:0@lo:400: 00000100:00100000:0.0:1788636300.927327:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636300.927360:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636300.927367:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976348160:0@lo:400: 00000100:00100000:0.0:1788636300.927390:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636300.927420:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976347904:0@lo:400: 00000100:00100000:0.0:1788636300.927563:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636300.927590:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976348416:0@lo:400: 00000100:00100000:0.0:1788636300.927609:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636300.927625:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636300.927630:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976348032:0@lo:400: 00000100:00100000:0.0:1788636300.927646:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636300.927674:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976347776 00000100:00100000:0.0:1788636300.927680:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976347776 00000100:00100000:0.0:1788636300.927724:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788636300.927740:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976347776:12345-0@lo:400: 00000100:00100000:2.0:1788636300.927960:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976348288 00000100:00100000:2.0:1788636300.927965:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976348288 00000100:00100000:2.0:1788636300.928002:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976347904 00000100:00100000:2.0:1788636300.928005:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976347904 00000100:00100000:2.0:1788636300.928014:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976348032 00000100:00100000:2.0:1788636300.928016:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976348032 00000100:00100000:2.0:1788636300.928027:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636300.928032:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976348288:12345-0@lo:400: 00000100:00100000:3.0:1788636300.928142:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636300.928150:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976347904:12345-0@lo:400: 00000100:00100000:2.0:1788636300.928262:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976348288:12345-0@lo:400: Request processed in 228us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636300.928269:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636300.928286:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636300.928293:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976348032:12345-0@lo:400: 00000100:00100000:2.0:1788636300.928326:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976348032:12345-0@lo:400: Request processed in 34us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636300.928332:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1788636300.928347:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636300.928386:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976348032:0@lo:400: 00000100:00100000:3.0:1788636300.931648:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976347904:12345-0@lo:400: Request processed in 3487us (4073us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636300.931661:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788636300.932066:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976347904:0@lo:400: 00000100:00100000:2.0:1788636300.932878:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976348160 00000100:00100000:2.0:1788636300.932889:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976348160 00000100:00100000:2.0:1788636300.932967:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976348416 00000100:00100000:2.0:1788636300.932971:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976348416 00000100:00100000:2.0:1788636300.932999:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788636300.933008:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788636300.933021:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976348416:12345-0@lo:400: 00000100:00100000:2.0:1788636300.933023:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976348160:12345-0@lo:400: 00000100:00080000:1.0:1788636300.933102:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636300.933107:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636300.933117:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976348416:12345-0@lo:400: Request processed in 100us (5505us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636300.933125:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788636300.933154:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75cfd880 x1875520976348416/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636300.933167:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976348416:0@lo:400: 00000100:00100000:0.0:1788636300.935231:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976347776:12345-0@lo:400: Request processed in 7482us (7968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636300.935245:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788636300.935333:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976347776:0@lo:400: 00000100:00100000:0.0:1788636300.935352:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976348288:0@lo:400: 00000100:00100000:2.0:1788636300.941576:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976348160:12345-0@lo:400: Request processed in 8557us (14173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636300.941590:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1788636300.941891:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75cfc000 x1875520976348160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636316 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636300.941908:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976348160:0@lo:400: 00000020:00000080:2.0:1788636301.381537:0:8428:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffda03e1850 20000000:00000080:2.0:1788636301.381559:0:8428:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cfd75dcb000 uarg=0000000000000000 20000000:01000000:2.0:1788636301.381604:0:8428:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788636301.381607:0:8428:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788636301.381610:0:8428:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788636301.381616:0:8428:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788636301.381622:0:8428:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788636301.381639:0:8428:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788636301.381641:0:8428:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788636301.385713:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788636301.385720:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788636301.389717:0:8429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1788636301.390545:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1788636301.390623:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1788636301.391102:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1788636301.391123:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788636301.391126:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1788636301.393465:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788636301.394387:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788636301.394458:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788636301.394498:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788636301.394512:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788636301.394515:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788636301.397624:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:2.0:1788636301.398496:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:2.0:1788636301.398540:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:2.0:1788636301.398581:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:2.0:1788636301.398593:0:8428:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788636301.398601:0:8428:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788636301.411120:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1788636301.414540:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1788636301.414602:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1788636301.414648:0:8428:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1788636301.414672:0:8428:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788636301.414697:0:8428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414721:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414730:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414738:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414744:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414762:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414770:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414775:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414786:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414854:0:8428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414865:0:8428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414921:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.414941:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 9 pid: 5803 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.414959:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976348544:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636301.415079:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.415089:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 9 pid: 5804 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.415105:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976348672:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636301.415136:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.415147:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 18 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.415158:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976348800:0@lo:104: 00000100:00100000:1.0:1788636301.415212:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636301.415278:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976348800 00000100:00100000:0.0:1788636301.415293:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976348800 00010000:00010000:1.0:1788636301.415328:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.415339:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 18 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.415349:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976348928:0@lo:104: 00000100:00100000:0.0:1788636301.415373:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788636301.415381:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636301.415393:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:8428:x1875520976348800:12345-0@lo:104: 00010000:00010000:1.0:1788636301.415404:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.415413:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.415415:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 18 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.415452:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349056:0@lo:104: 00010000:00010000:1.0:1788636301.415480:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.415488:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 18 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.415507:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349184:0@lo:104: 00010000:00010000:0.0:1788636301.415542:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:1.0:1788636301.415545:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636301.415559:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:8428:x1875520976348800:12345-0@lo:104: Request processed in 167us (339us total) trans 0 rc 0/0 00010000:00010000:1.0:1788636301.415565:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 18 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636301.415584:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788636301.415588:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349312:0@lo:104: 00010000:00010000:1.0:1788636301.415614:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.415623:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 18 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.415633:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349440:0@lo:104: 00000100:00100000:0.0:1788636301.415634:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788636301.415673:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636301.415680:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636301.415688:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.415706:0:8428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.415734:0:8428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 18 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.415744:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c000 already unused, calling callback (ffffffffc1de6c20) 00000100:00100000:1.0:1788636301.415750:0:8428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349568:0@lo:104: 10000000:00010000:0.0:1788636301.415755:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.415766:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.415779:0:8428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:0.0:1788636301.415784:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.415794:0:8428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6e40 going to sleep for 11 seconds 10000000:01000000:0.0:1788636301.415833:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636301.415877:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.415884:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636301.415904:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.415911:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997c000/0xa6aa59fb12fa7210 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7217 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.415924:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636301.415927:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636301.415929:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636301.415943:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636301.415963:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636301.415974:0:5793:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636301.415988:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976348928 00000100:00100000:0.0:1788636301.415992:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976348928 00000100:00100000:0.0:1788636301.416010:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976349440 00000100:00100000:0.0:1788636301.416019:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976349440 00000100:00100000:0.0:1788636301.416032:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976349568 00000100:00100000:0.0:1788636301.416035:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976349568 00000100:00100000:0.0:1788636301.416044:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976349056 00000100:00100000:0.0:1788636301.416046:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976349056 00000100:00100000:0.0:1788636301.416054:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976349184 00000100:00100000:0.0:1788636301.416056:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976349184 00000100:00100000:0.0:1788636301.416064:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976349312 00000100:00100000:0.0:1788636301.416066:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976349312 00000100:00100000:0.0:1788636301.416078:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788636301.416084:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f985050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+8:8428:x1875520976348928:12345-0@lo:104: 00010000:00010000:0.0:1788636301.416092:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.416131:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788636301.416137:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f985050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+8:8428:x1875520976348928:12345-0@lo:104: Request processed in 53us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636301.416143:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636301.416282:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636301.416293:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+7:8428:x1875520976349440:12345-0@lo:104: 00010000:00010000:2.0:1788636301.416301:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636301.416341:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788636301.416346:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+7:8428:x1875520976349440:12345-0@lo:104: Request processed in 58us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636301.416351:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636301.416363:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636301.416368:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+6:8428:x1875520976349568:12345-0@lo:104: 00010000:00010000:2.0:1788636301.416375:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636301.416398:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788636301.416403:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+6:8428:x1875520976349568:12345-0@lo:104: Request processed in 35us (631us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636301.416407:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636301.416416:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636301.416421:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+5:8428:x1875520976349056:12345-0@lo:104: 00010000:00010000:2.0:1788636301.416427:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636301.416448:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788636301.416453:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+5:8428:x1875520976349056:12345-0@lo:104: Request processed in 33us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636301.416458:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636301.416476:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788636301.416483:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+4:8428:x1875520976349184:12345-0@lo:104: 00010000:00010000:2.0:1788636301.416490:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636301.416515:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788636301.416519:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+4:8428:x1875520976349184:12345-0@lo:104: Request processed in 38us (556us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636301.416524:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788636301.416535:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788636301.416540:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:8428:x1875520976349312:12345-0@lo:104: 00010000:00010000:2.0:1788636301.416547:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636301.416568:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788636301.416572:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:8428:x1875520976349312:12345-0@lo:104: Request processed in 33us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636301.416577:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636301.418750:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976348800:0@lo:104: 00000100:00100000:1.0:1788636301.418781:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dd880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976348928:0@lo:104: 00000100:00100000:0.0:1788636301.419326:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976349696:0@lo:103: 00000100:00100000:0.0:1788636301.419402:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788636301.419462:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1788636301.419470:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419480:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40030a00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636301.419485:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419495:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636301.419522:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636301.419528:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636301.419566:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419573:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636301.419589:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419596:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa71e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71ed expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419612:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1788636301.419616:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419622:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167d600 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636301.419624:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419630:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636301.419635:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636301.419640:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636301.419707:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419713:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636301.419719:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419725:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d600/0xa6aa59fb12fa7184 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa718b expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419734:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788636301.419737:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419742:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167ca00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636301.419745:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419751:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636301.419756:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636301.419760:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636301.419770:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419775:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636301.419785:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419829:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa715a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7161 expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419839:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636301.419842:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419847:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff400 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636301.419850:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419857:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636301.419863:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636301.419868:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636301.419882:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419887:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636301.419892:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419899:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff400/0xa6aa59fb12fa71ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71d1 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419909:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636301.419921:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419926:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167da00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636301.419929:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419935:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636301.419940:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636301.419944:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636301.419956:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419961:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636301.419965:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419970:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa71bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71c3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419978:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636301.419981:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.419986:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167d200 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636301.419988:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.420004:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636301.420010:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636301.420015:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636301.420028:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.420033:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636301.420037:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.420042:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa71ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa71b5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.420055:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636301.420056:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636301.420058:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636301.420065:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636301.420088:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976349696 00000100:00100000:0.0:1788636301.420095:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976349696 00010000:00010000:0.0:1788636301.420124:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 19 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636301.420151:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636301.420160:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976349696:12345-0@lo:103: 00000100:00100000:3.0:1788636301.420516:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976349952:0@lo:103: 00000100:00100000:3.0:1788636301.420562:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636301.420594:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976350464:0@lo:103: 00000100:00100000:3.0:1788636301.420614:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636301.420633:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788636301.420638:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976349824:0@lo:103: 00000100:00100000:3.0:1788636301.420658:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636301.420667:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976350336:0@lo:103: 00000100:00100000:3.0:1788636301.420698:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636301.420719:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976349952 00000100:00100000:3.0:1788636301.420723:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976349952 00010000:00010000:3.0:1788636301.420739:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 20 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636301.420763:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976350464 00000100:00100000:3.0:1788636301.420766:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976350464 00010000:00010000:3.0:1788636301.420781:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 21 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636301.420791:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976349824 00000100:00100000:3.0:1788636301.420826:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976349824 00010000:00010000:3.0:1788636301.420840:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 22 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636301.420863:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976350336 00000100:00100000:3.0:1788636301.420865:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976350336 00010000:00010000:3.0:1788636301.420876:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 23 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636301.420887:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636301.420895:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+23:3283:x1875520976349952:12345-0@lo:103: 00010000:00010000:3.0:1788636301.420906:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636301.420912:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 23 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.420934:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 23 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.420953:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636301.420991:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+23:3283:x1875520976349952:12345-0@lo:103: Request processed in 97us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636301.420997:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636301.421016:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788636301.421030:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+22:3283:x1875520976350464:12345-0@lo:103: 00010000:00010000:3.0:1788636301.421037:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636301.421042:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 22 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.421048:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 22 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.421057:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636301.421078:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+22:3283:x1875520976350464:12345-0@lo:103: Request processed in 50us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636301.421084:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788636301.421096:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636301.421101:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+21:3283:x1875520976349824:12345-0@lo:103: 00010000:00010000:3.0:1788636301.421108:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636301.421112:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 21 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.421121:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 21 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.421130:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031e00/0xa6aa59fb12fa71ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa71e6 expref: 21 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.421140:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636301.421162:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+20:3283:x1875520976349824:12345-0@lo:103: Request processed in 60us (502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636301.421168:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636301.421179:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788636301.421190:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976350336:12345-0@lo:103: 00010000:00010000:3.0:1788636301.421199:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636301.421203:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 19 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.421210:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 19 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636301.421218:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636301.421239:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976350336:12345-0@lo:103: Request processed in 49us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636301.421244:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788636301.421497:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636301.421589:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 18 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.421599:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 18 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.421610:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa7217 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7210 expref: 18 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.421621:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636301.421651:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+17:3281:x1875520976349696:12345-0@lo:103: Request processed in 1492us (2249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636301.421658:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636301.421690:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976350080:0@lo:103: 00000100:00100000:0.0:1788636301.421719:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636301.421750:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636301.421756:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976350208:0@lo:103: 00000100:00100000:0.0:1788636301.421780:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636301.421843:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976349696:0@lo:103: 00000100:00100000:0.0:1788636301.421866:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976350080 00000100:00100000:0.0:1788636301.421871:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976350080 00010000:00010000:0.0:1788636301.421887:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 17 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636301.421900:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976350208 00000100:00100000:0.0:1788636301.421902:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976350208 00010000:00010000:0.0:1788636301.421912:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 18 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636301.421922:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788636301.422012:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349056:0@lo:104: 00000100:00100000:2.0:1788636301.422030:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976349824:0@lo:103: 00010000:00010000:1.0:1788636301.422035:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa71c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa71bc expref: 18 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636301.422050:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976350336:0@lo:103: 00000100:00100000:1.0:1788636301.422058:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5df800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349184:0@lo:104: 00000100:00100000:2.0:1788636301.422065:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976349952:0@lo:103: 00010000:00010000:1.0:1788636301.422085:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa71b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ae expref: 17 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636301.422091:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976350464:0@lo:103: 00000100:00100000:1.0:1788636301.422115:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5ddc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349312:0@lo:104: 00010000:00010000:1.0:1788636301.422136:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa718b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7184 expref: 16 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.422149:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349440:0@lo:104: 00000100:00100000:1.0:1788636301.422161:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976349568:0@lo:104: 00000100:00100000:1.0:1788636301.422227:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636301.422241:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+15:3280:x1875520976350208:12345-0@lo:103: 00010000:00010000:1.0:1788636301.422259:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636301.422267:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 15 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.422278:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 15 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.422297:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa71d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa71ca expref: 15 pid: 5805 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636301.422309:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636301.422384:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699abc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+14:3280:x1875520976350208:12345-0@lo:103: Request processed in 149us (603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636301.422391:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+14:3280:x1875520976350080:12345-0@lo:103: 00010000:00010000:0.0:1788636301.422404:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1788636301.422411:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788636301.422413:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 14 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.422426:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 14 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.422441:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa7161 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa715a expref: 13 pid: 5804 timeout: 320 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.422455:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636301.422492:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+12:3280:x1875520976350080:12345-0@lo:103: Request processed in 111us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636301.422498:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788636301.422589:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976350208:0@lo:103: 00000100:00100000:2.0:1788636301.422597:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976350080:0@lo:103: 00000100:00100000:1.0:1788636301.430704:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636301.430752:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636301.430793:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963743744 00000100:00100000:0.0:1788636301.430852:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963743744 00000100:00100000:3.0:1788636301.430902:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963743872 00010000:00010000:0.0:1788636301.430909:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 10 pid: 5803 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636301.430910:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963743872 00010000:00010000:3.0:1788636301.430934:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 11 pid: 5804 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636301.430970:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:0.0:1788636301.430983:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+11:2361:x1875520963743744:12345-192.168.203.57@tcp:103: 00010000:00010000:0.0:1788636301.431013:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636301.431021:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 11 pid: 5803 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636301.431030:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976348544:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636301.431043:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 11 pid: 5803 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636301.431049:0:8428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8428:1875520976348672:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636301.431082:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa722c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155402 expref: 11 pid: 5803 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431117:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636301.431133:0:8428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636301.431203:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+10:2361:x1875520963743744:12345-192.168.203.57@tcp:103: Request processed in 221us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636301.431210:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:0.0:1788636301.431228:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:0.0:1788636301.431234:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+9:2361:x1875520963743872:12345-192.168.203.57@tcp:103: 00010000:00010000:0.0:1788636301.431242:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636301.431247:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 9 pid: 5804 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431256:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 9 pid: 5804 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431265:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031600/0xa6aa59fb12fa7225 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351553fb expref: 9 pid: 5804 timeout: 270 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431278:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431286:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431300:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431307:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431314:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431329:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431335:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167cc00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636301.431339:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431348:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431360:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636301.431371:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636301.431391:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+8:2361:x1875520963743872:12345-192.168.203.57@tcp:103: Request processed in 157us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636301.431397:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 20 00010000:00010000:2.0:1788636301.431630:0:8428:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636301.431641:0:8428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636301.431648:0:8428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167cc00/0xa6aa59fb12fa7264 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636301.441497:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976350592:0@lo:13: 00000100:00100000:1.0:1788636301.441573:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636301.441915:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976350592 00000100:00100000:0.0:1788636301.441924:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976350592 00000100:00100000:0.0:1788636301.441972:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636301.441982:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976350592:12345-0@lo:13: 00002000:00000024:0.0:1788636301.442378:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636301.442436:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976350592:12345-0@lo:13: Request processed in 455us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636301.442444:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1788636301.442484:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a282300 x1875520976350592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636317 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636301.442501:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976350592:0@lo:13: 00010000:00010000:0.0:1788636301.887466:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788636302.782925:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788636302.782933:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd613ba800 from 39 10000000:01000000:3.0:1788636302.782939:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788636302.782986:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.782997:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.783008:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636302.783033:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976350720:0@lo:101: 00000100:00100000:3.0:1788636302.783117:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.783236:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976350720 00000100:00100000:1.0:1788636302.783244:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976350720 00000100:00100000:1.0:1788636302.783352:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788636302.783362:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+12:5808:x1875520976350720:12345-0@lo:101: 00010000:00010000:1.0:1788636302.783375:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636302.783390:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa7272 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa726b expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.783413:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa7272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa726b expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.783423:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa7272 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa726b expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.783432:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167de00, rc 0) 00000100:00100000:3.0:1788636302.783457:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636302.783467:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976350720:12345-0@lo:101: Request processed in 107us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636302.783472:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788636302.783477:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976350720:0@lo:101: 00010000:00010000:3.0:1788636302.783492:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.783501:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636302.783551:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976350848:0@lo:501: 00000100:00100000:3.0:1788636302.783577:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636302.789213:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.790788:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976350848 00000100:00100000:2.0:1788636302.790824:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976350848 00000100:00100000:2.0:1788636302.791010:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788636302.791021:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976350848:12345-0@lo:501: 00000100:00100000:2.0:1788636302.791463:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976350848:12345-0@lo:501: Request processed in 442us (7883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.791471:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788636302.793265:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976350848:0@lo:501: 00000100:00100000:3.0:1788636302.793321:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976350976:0@lo:503: 00000100:00100000:3.0:1788636302.793383:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636302.793415:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fab40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.795095:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976350976 00000100:00100000:2.0:1788636302.795106:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976350976 00000100:00100000:2.0:1788636302.795397:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788636302.795408:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976350976:12345-0@lo:503: 00000100:00100000:2.0:1788636302.795621:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976350976:12345-0@lo:503: Request processed in 215us (2238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.795629:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788636302.795880:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976350976:0@lo:503: 00000100:00100000:2.0:1788636302.796314:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8446:1875520976351104:0@lo:502: 00000100:00100000:2.0:1788636302.796357:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636302.796423:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61158cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636302.796465:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976351104 00000100:00100000:3.0:1788636302.796470:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976351104 00000100:00100000:3.0:1788636302.796503:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788636302.796512:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:8446:x1875520976351104:12345-0@lo:502: 00000100:00100000:3.0:1788636302.796734:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:8446:x1875520976351104:12345-0@lo:502: Request processed in 222us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.796740:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788636302.796912:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8446:1875520976351104:0@lo:502: 00000100:00100000:2.0:1788636302.796966:0:8446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8446:1875520976351232:0@lo:502: 00000100:00100000:2.0:1788636302.797014:0:8446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636302.797081:0:8446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61158cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636302.800042:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976351232 00000100:00100000:3.0:1788636302.800055:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976351232 00000100:00100000:3.0:1788636302.800225:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788636302.800237:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:8446:x1875520976351232:12345-0@lo:502: 00000100:00100000:3.0:1788636302.800490:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+13:8446:x1875520976351232:12345-0@lo:502: Request processed in 256us (3475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.800497:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788636302.802070:0:8446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8446:1875520976351232:0@lo:502: 00000040:00080000:2.0:1788636302.802111:0:8446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788636302.802308:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788636302.802328:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788636302.802339:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.802350:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636302.802359:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1788636302.802361:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1788636302.802364:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788636302.802399:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.802407:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.802416:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636302.802433:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976351360:0@lo:101: 00000100:00100000:0.0:1788636302.802483:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.802527:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.802589:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976351360 00000100:00100000:2.0:1788636302.802596:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976351360 00000100:00100000:2.0:1788636302.802629:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788636302.802637:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+13:5808:x1875520976351360:12345-0@lo:101: 00010000:00010000:2.0:1788636302.802649:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636302.802673:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521fe600/0xa6aa59fb12fa7280 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7279 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.802868:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521fe600/0xa6aa59fb12fa7280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7279 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.802953:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521fe600/0xa6aa59fb12fa7280 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7279 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.803030:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe600, rc 0) 00000100:00100000:2.0:1788636302.803072:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976351360:12345-0@lo:101: Request processed in 435us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.803078:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788636302.803251:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976351360:0@lo:101: 00010000:00010000:0.0:1788636302.803265:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.803275:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636302.803330:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976351488:0@lo:501: 00000100:00100000:0.0:1788636302.803358:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.803482:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.803522:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976351488 00000100:00100000:2.0:1788636302.803527:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976351488 00000100:00100000:2.0:1788636302.803547:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788636302.803554:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976351488:12345-0@lo:501: 00000100:00100000:2.0:1788636302.804027:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976351488:12345-0@lo:501: Request processed in 472us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.804034:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788636302.804237:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976351488:0@lo:501: 00000100:00100000:0.0:1788636302.804271:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976351616:0@lo:503: 00000100:00100000:0.0:1788636302.804311:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.804338:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942300 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.804388:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976351616 00000100:00100000:2.0:1788636302.804393:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976351616 00000100:00100000:2.0:1788636302.804413:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788636302.804419:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976351616:12345-0@lo:503: 00000100:00100000:2.0:1788636302.804584:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976351616:12345-0@lo:503: Request processed in 163us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.804590:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788636302.804674:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976351616:0@lo:503: 00000100:00100000:0.0:1788636302.805283:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8447:1875520976351744:0@lo:502: 00000100:00100000:0.0:1788636302.805326:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.805359:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.805404:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976351744 00000100:00100000:2.0:1788636302.805409:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976351744 00000100:00100000:2.0:1788636302.805431:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788636302.805439:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:8447:x1875520976351744:12345-0@lo:502: 00000100:00100000:2.0:1788636302.805646:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:8447:x1875520976351744:12345-0@lo:502: Request processed in 206us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.805653:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788636302.810634:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8447:1875520976351744:0@lo:502: 00000020:01000000:0.0:1788636302.810690:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636302.811044:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636302.811048:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788636302.811055:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788636302.811094:0:8447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8447:1875520976351872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636302.811170:0:8447:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.811215:0:8447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.811273:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976351872 00000100:00100000:2.0:1788636302.811280:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976351872 00000100:00100000:2.0:1788636302.811334:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788636302.811343:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:8447:x1875520976351872:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636302.811562:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+14:8447:x1875520976351872:12345-0@lo:502:llog_process_th.0 Request processed in 220us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.811579:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788636302.812059:0:8447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8447:1875520976351872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636302.812083:0:8447:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636302.812089:0:8447:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636302.812091:0:8447:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788636302.812094:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788636302.812244:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788636302.812259:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788636302.812267:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.812277:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636302.812285:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788636302.812288:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd76a12000 from 39 10000000:01000000:2.0:1788636302.812291:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788636302.812318:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.812326:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.812334:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636302.812351:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636302.812383:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636302.812403:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61158c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636302.812461:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976352000 00000100:00100000:1.0:1788636302.812466:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976352000 00000100:00100000:1.0:1788636302.812500:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788636302.812508:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+14:5808:x1875520976352000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636302.812528:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636302.812540:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa728e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7287 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.812562:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa728e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7287 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.812572:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa728e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7287 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.812580:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167c000, rc 0) 00000100:00100000:1.0:1788636302.812621:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976352000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636302.812627:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788636302.813088:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636302.813101:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.813111:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636302.813157:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.813185:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.813256:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636302.813504:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976352128 00000100:00100000:3.0:1788636302.813509:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976352128 00000100:00100000:3.0:1788636302.813577:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788636302.813585:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976352128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636302.814053:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976352128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 467us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.814061:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788636302.814126:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.814160:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.814199:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.814372:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636302.814444:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976352256 00000100:00100000:1.0:1788636302.814449:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976352256 00000100:00100000:0.0:1788636302.814535:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788636302.814542:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976352256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.814698:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976352256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.814705:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788636302.814777:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.815270:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8448:1875520976352384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636302.815310:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.815339:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636302.815385:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976352384 00000100:00100000:0.0:1788636302.815390:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976352384 00000100:00100000:0.0:1788636302.815411:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788636302.815417:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:8448:x1875520976352384:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636302.815584:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:8448:x1875520976352384:12345-0@lo:502:llog_process_th.0 Request processed in 166us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.815599:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788636302.815667:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8448:1875520976352384:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636302.815704:0:8448:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8448:1875520976352512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636302.815735:0:8448:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.815756:0:8448:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636302.815832:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976352512 00000100:00100000:0.0:1788636302.815836:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976352512 00000100:00100000:0.0:1788636302.816051:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788636302.816061:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:8448:x1875520976352512:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636302.816207:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+15:8448:x1875520976352512:12345-0@lo:502:llog_process_th.0 Request processed in 147us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.816214:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788636302.816284:0:8448:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8448:1875520976352512:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1788636302.816305:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788636302.816443:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788636302.816459:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788636302.816468:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.816478:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636302.816487:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788636302.816490:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788636302.816493:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788636302.816517:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.816525:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.816534:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636302.816547:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.816583:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.816648:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636302.816697:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976352640 00000100:00100000:3.0:1788636302.816702:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976352640 00000100:00100000:2.0:1788636302.816763:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788636302.816773:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+15:5808:x1875520976352640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636302.816782:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636302.816829:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa729c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7295 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.816871:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa729c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7295 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.816888:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa729c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7295 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.816896:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fee00, rc 0) 00000100:00100000:2.0:1788636302.816927:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976352640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.816932:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788636302.817007:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636302.817019:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.817027:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636302.817067:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.817091:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.817322:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636302.817380:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976352768 00000100:00100000:1.0:1788636302.817384:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976352768 00000100:00100000:1.0:1788636302.817406:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788636302.817412:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976352768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.817663:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976352768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 250us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636302.817669:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788636302.817758:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.817786:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.818042:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.818094:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.818144:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976352896 00000100:00100000:2.0:1788636302.818148:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976352896 00000100:00100000:1.0:1788636302.818225:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788636302.818360:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976352896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636302.818547:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976352896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 315us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.818554:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788636302.818615:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976352896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636302.819228:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8449:1875520976353024:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636302.819270:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636302.819303:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7facc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.819348:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976353024 00000100:00100000:2.0:1788636302.819353:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976353024 00000100:00100000:2.0:1788636302.819387:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788636302.819395:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+16:8449:x1875520976353024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636302.819587:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+16:8449:x1875520976353024:12345-0@lo:502:llog_process_th.0 Request processed in 192us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.819595:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788636302.819714:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8449:1875520976353024:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636302.819736:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636302.819745:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636302.819747:0:8449:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788636302.819752:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788636302.819772:0:8449:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8449:1875520976353152:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636302.820283:0:8449:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636302.820345:0:8449:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636302.820379:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976353152 00000100:00100000:3.0:1788636302.820384:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976353152 00000100:00100000:3.0:1788636302.820446:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788636302.820454:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:8449:x1875520976353152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636302.820637:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:8449:x1875520976353152:12345-0@lo:502:llog_process_th.0 Request processed in 184us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.820651:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1788636302.820713:0:8449:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8449:1875520976353152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636302.820734:0:8449:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636302.820740:0:8449:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636302.820741:0:8449:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788636302.820745:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1788636302.820982:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1788636302.820999:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788636302.821009:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.821019:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636302.821029:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788636302.821032:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd613a5000 from 39 10000000:01000000:1.0:1788636302.821034:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788636302.821060:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.821068:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.821083:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636302.821100:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976353280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.821131:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.821367:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.821399:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976353280 00000100:00100000:2.0:1788636302.821404:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976353280 00000100:00100000:3.0:1788636302.821441:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788636302.821450:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976353280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636302.821459:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636302.821471:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c600/0xa6aa59fb12fa72aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa72a3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.821492:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c600/0xa6aa59fb12fa72aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72a3 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.821501:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c600/0xa6aa59fb12fa72aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72a3 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.821510:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c600, rc 0) 00000100:00100000:3.0:1788636302.821550:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976353280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.821556:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788636302.821611:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976353280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636302.821623:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.821631:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636302.821673:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976353408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.821698:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.821831:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636302.821870:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976353408 00000100:00100000:0.0:1788636302.822009:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976353408 00000100:00100000:0.0:1788636302.822032:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788636302.822039:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976353408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.822273:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976353408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.822279:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788636302.822339:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976353408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.822365:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976353536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.822396:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.822414:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636302.822448:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976353536 00000100:00100000:0.0:1788636302.822451:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976353536 00000100:00100000:0.0:1788636302.822466:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788636302.822472:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976353536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.822599:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976353536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.822606:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788636302.822660:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976353536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.823206:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8450:1875520976353664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636302.823242:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.823343:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c60c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636302.823378:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976353664 00000100:00100000:0.0:1788636302.823383:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976353664 00000100:00100000:0.0:1788636302.823436:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788636302.823442:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:8450:x1875520976353664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636302.823601:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:8450:x1875520976353664:12345-0@lo:502:llog_process_th.0 Request processed in 159us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.823607:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788636302.823660:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8450:1875520976353664:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636302.823693:0:8450:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8450:1875520976353792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636302.823721:0:8450:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.823823:0:8450:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.826048:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976353792 00000100:00100000:2.0:1788636302.826061:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976353792 00000100:00100000:2.0:1788636302.826120:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788636302.826128:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+17:8450:x1875520976353792:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636302.826463:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+17:8450:x1875520976353792:12345-0@lo:502:llog_process_th.0 Request processed in 335us (2739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.826471:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788636302.828158:0:8450:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8450:1875520976353792:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788636302.828255:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788636302.829996:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788636302.830026:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788636302.830037:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.830049:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636302.830058:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788636302.830061:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1788636302.830063:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788636302.830103:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.830110:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.830122:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636302.830145:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976353920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.830205:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.830251:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.830314:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976353920 00000100:00100000:2.0:1788636302.830321:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976353920 00000100:00100000:2.0:1788636302.830372:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788636302.830381:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976353920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636302.830394:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636302.830407:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521ff400/0xa6aa59fb12fa72b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa72b1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.830430:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521ff400/0xa6aa59fb12fa72b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72b1 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.830440:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521ff400/0xa6aa59fb12fa72b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72b1 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636302.830449:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ff400, rc 0) 00000100:00100000:2.0:1788636302.830494:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976353920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.830501:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788636302.830599:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976353920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636302.830612:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.830619:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636302.830665:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976354048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.830690:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.830710:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.831021:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976354048 00000100:00100000:2.0:1788636302.831026:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976354048 00000100:00100000:2.0:1788636302.831057:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788636302.831064:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976354048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636302.831305:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976354048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.831319:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788636302.831391:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976354048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.831420:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976354176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.831460:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.831487:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd480 going to sleep for 11 seconds 00000100:00100000:0.0:1788636302.831530:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976354176 00000100:00100000:0.0:1788636302.831535:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976354176 00000100:00100000:0.0:1788636302.831555:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788636302.831562:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976354176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.831712:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976354176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (251us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.831719:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788636302.831784:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976354176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.832234:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8451:1875520976354304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636302.832270:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.832297:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788636302.832429:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976354304 00000100:00100000:0.0:1788636302.832434:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976354304 00000100:00100000:0.0:1788636302.832473:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788636302.832480:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:8451:x1875520976354304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636302.832691:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:8451:x1875520976354304:12345-0@lo:502:llog_process_th.0 Request processed in 211us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.832699:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788636302.836079:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8451:1875520976354304:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636302.840026:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636302.840045:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636302.840047:0:8451:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788636302.840055:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788636302.840108:0:8451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8451:1875520976354432:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636302.840191:0:8451:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.840285:0:8451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636302.843210:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976354432 00000100:00100000:3.0:1788636302.843224:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976354432 00000100:00100000:3.0:1788636302.843321:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788636302.843332:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:8451:x1875520976354432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636302.843609:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:8451:x1875520976354432:12345-0@lo:502:llog_process_th.0 Request processed in 278us (3417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.843617:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788636302.843699:0:8451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8451:1875520976354432:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636302.843730:0:8451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636302.843737:0:8451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636302.843739:0:8451:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788636302.843744:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1788636302.844986:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1788636302.845013:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788636302.845024:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.845036:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636302.845059:0:5808:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788636302.845062:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cfd5d20cd40 from 1 10000000:01000000:1.0:1788636302.845064:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788636302.845096:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.845103:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636302.845111:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636302.845131:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976354560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636302.845177:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636302.849905:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636302.850043:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976354560 00000100:00100000:2.0:1788636302.850053:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976354560 00000100:00100000:3.0:1788636302.850223:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788636302.850237:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976354560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636302.850269:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636302.850288:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa72c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa72bf expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.850316:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa72c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72bf expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.850328:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa72c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72bf expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636302.850337:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c800, rc 0) 00000100:00100000:3.0:1788636302.850421:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976354560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (5243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.850428:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788636302.851063:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976354560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636302.851082:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72c6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.851093:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa72c6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636302.851162:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976354688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636302.851199:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636302.851232:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636302.851474:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976354688 00000100:00100000:3.0:1788636302.851479:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976354688 00000100:00100000:3.0:1788636302.851549:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788636302.851557:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976354688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636302.851773:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976354688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 216us (572us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636302.851780:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788636302.851858:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976354688:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788636302.851893:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788636302.851900:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72c6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.851910:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72c6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636302.911100:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636302.923508:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636302.923549:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636302.923581:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636302.923612:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636302.923640:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963744384 00000100:00100000:3.0:1788636302.923650:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963744384 00000100:00100000:3.0:1788636302.923700:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963744256 00000100:00100000:3.0:1788636302.923715:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963744256 00000100:00100000:1.0:1788636302.923742:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:1.0:1788636302.923757:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963744384:12345-192.168.203.57@tcp:400: 00000100:00100000:3.0:1788636302.923846:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:3.0:1788636302.923854:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d297100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963744256:12345-192.168.203.57@tcp:400: 00000100:00100000:1.0:1788636302.923873:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963744384:12345-192.168.203.57@tcp:400: Request processed in 118us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636302.923883:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:3.0:1788636302.923885:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d297100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963744256:12345-192.168.203.57@tcp:400: Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.923892:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00080000:1.0:1788636302.923912:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636302.923917:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636302.924440:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963744000 00000100:00100000:0.0:1788636302.924446:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963744000 00000100:00100000:2.0:1788636302.924452:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963744128 00000100:00100000:2.0:1788636302.924456:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963744128 00000100:00100000:0.0:1788636302.924478:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 162 00000100:00100000:0.0:1788636302.924486:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+8:2362:x1875520963744000:12345-192.168.203.57@tcp:400: 00000100:00100000:2.0:1788636302.924498:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:2.0:1788636302.924505:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963744128:12345-192.168.203.57@tcp:400: 00000100:00100000:0.0:1788636302.924515:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+8:2362:x1875520963744000:12345-192.168.203.57@tcp:400: Request processed in 29us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636302.924521:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 162 00000100:00100000:2.0:1788636302.924529:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963744128:12345-192.168.203.57@tcp:400: Request processed in 25us (1031us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636302.924534:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00080000:1.0:1788636302.925299:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636302.975135:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636302.975159:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976354816:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636302.975230:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636302.975366:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976354816 00000100:00100000:3.0:1788636302.975375:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976354816 00000100:00100000:3.0:1788636302.975447:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636302.975457:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976354816:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636302.975493:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636302.975549:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976354816:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636302.975556:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1788636302.975644:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd5d294380 x1875520976354816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636318 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636302.975663:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976354816:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788636302.975721:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788636303.935005:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636304.204535:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636304.205756:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963744512 00000100:00100000:3.0:1788636304.205768:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963744512 00000100:00100000:3.0:1788636304.205864:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 163 00000100:00100000:3.0:1788636304.205873:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+8:5600:x1875520963744512:12345-192.168.203.57@tcp:101: 00010000:00010000:3.0:1788636304.206200:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636304.206221:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c000/0xa6aa59fb12fa72cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155464 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636304.206251:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c000/0xa6aa59fb12fa72cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155464 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636304.206263:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c000/0xa6aa59fb12fa72cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155464 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636304.206290:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c000, rc 0) 00000100:00100000:3.0:1788636304.206358:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+9:5600:x1875520963744512:12345-192.168.203.57@tcp:101: Request processed in 486us (1832us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636304.206365:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 163 00000100:00100000:3.0:1788636304.208536:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636304.208621:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963744640 00000100:00100000:2.0:1788636304.208630:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963744640 00000100:00100000:2.0:1788636304.208693:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 164 00000100:00100000:2.0:1788636304.208702:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+9:5600:x1875520963744640:12345-192.168.203.57@tcp:501: 00000100:00100000:2.0:1788636304.209014:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+9:5600:x1875520963744640:12345-192.168.203.57@tcp:501: Request processed in 313us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636304.209022:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 164 00000100:00100000:0.0:1788636304.212706:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636304.212832:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963744768 00000100:00100000:3.0:1788636304.212843:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963744768 00000100:00100000:3.0:1788636304.212898:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 165 00000100:00100000:3.0:1788636304.212908:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+9:5600:x1875520963744768:12345-192.168.203.57@tcp:503: 00000100:00100000:3.0:1788636304.213178:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+9:5600:x1875520963744768:12345-192.168.203.57@tcp:503: Request processed in 271us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636304.213186:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 165 00000100:00100000:3.0:1788636304.223998:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636304.227404:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963744896 00000100:00100000:2.0:1788636304.227418:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963744896 00000100:00100000:2.0:1788636304.227489:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 166 00000100:00100000:2.0:1788636304.227499:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+9:6080:x1875520963744896:12345-192.168.203.57@tcp:502: 00000100:00100000:2.0:1788636304.227787:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+9:6080:x1875520963744896:12345-192.168.203.57@tcp:502: Request processed in 288us (3797us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636304.227834:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 166 00000100:00100000:1.0:1788636304.237960:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636304.238064:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963745024 00000100:00100000:0.0:1788636304.238074:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963745024 00000100:00100000:0.0:1788636304.238127:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 167 00000100:00100000:0.0:1788636304.238138:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+9:6080:x1875520963745024:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636304.238428:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+9:6080:x1875520963745024:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 290us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636304.238443:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 167 00000100:00100000:0.0:1788636304.249966:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636304.250311:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963745152 00000100:00100000:2.0:1788636304.250333:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963745152 00000100:00100000:2.0:1788636304.250388:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 168 00000100:00100000:2.0:1788636304.250398:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+9:5600:x1875520963745152:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636304.250415:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636304.250455:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521fe000/0xa6aa59fb12fa72d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb98284483515546b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636304.250484:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521fe000/0xa6aa59fb12fa72d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515546b expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636304.250495:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521fe000/0xa6aa59fb12fa72d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515546b expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636304.250503:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe000, rc 0) 00000100:00100000:2.0:1788636304.250561:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:5600:x1875520963745152:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 Request processed in 164us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636304.250568:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 168 00000100:00100000:2.0:1788636304.264236:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636304.264379:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963745280 00000100:00100000:3.0:1788636304.264389:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963745280 00000100:00100000:3.0:1788636304.264445:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 169 00000100:00100000:3.0:1788636304.264455:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:5600:x1875520963745280:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636304.265133:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:5600:x1875520963745280:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 Request processed in 675us (914us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636304.265143:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 169 00010000:00010000:0.0:1788636304.958950:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788636305.672340:0:8489:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff8644b310 20000000:00000080:1.0:1788636305.672356:0:8489:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cfd7fe6e400 uarg=0000000000000000 20000000:01000000:1.0:1788636305.672389:0:8489:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788636305.672395:0:8489:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788636305.672400:0:8489:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788636305.678094:0:8490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1788636305.678390:0:8489:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1788636305.685515:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1788636305.685567:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1788636305.686683:0:8489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1788636305.686707:0:8489:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788636305.686726:0:8489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.686744:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7050 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.686752:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.686760:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.686769:0:8489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.686777:0:8489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.686846:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.686874:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 9 pid: 5804 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636305.686901:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875520976354944:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636305.687009:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.687018:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 18 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636305.687025:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875520976355072:0@lo:104: 00000100:00100000:1.0:1788636305.687062:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636305.687105:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.687114:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 18 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636305.687121:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875520976355200:0@lo:104: 00000100:00100000:1.0:1788636305.687147:0:8489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636305.687166:0:8489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.687174:0:8489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7050 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 18 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636305.687182:0:8489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875520976355328:0@lo:104: 00000100:00100000:1.0:1788636305.687199:0:8489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636305.688758:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788636305.688830:0:5794:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636305.688847:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976355072 00000100:00100000:0.0:1788636305.688855:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976355072 00000100:00100000:0.0:1788636305.688896:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976355200 00000100:00100000:0.0:1788636305.688899:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976355200 00000100:00100000:0.0:1788636305.688908:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976355328 00000100:00100000:0.0:1788636305.688911:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976355328 00000100:00100000:0.0:1788636305.688930:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636305.688939:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+5:8489:x1875520976355072:12345-0@lo:104: 00010000:00010000:0.0:1788636305.688954:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689015:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788636305.689022:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+5:8489:x1875520976355072:12345-0@lo:104: Request processed in 84us (1959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636305.689028:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636305.689045:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636305.689050:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+4:8489:x1875520976355200:12345-0@lo:104: 00010000:00010000:0.0:1788636305.689058:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689092:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788636305.689097:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b52050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+4:8489:x1875520976355200:12345-0@lo:104: Request processed in 48us (1950us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636305.689117:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636305.689152:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636305.689158:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:8489:x1875520976355328:12345-0@lo:104: 00010000:00010000:0.0:1788636305.689166:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689195:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788636305.689200:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:8489:x1875520976355328:12345-0@lo:104: Request processed in 43us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636305.689205:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1788636305.689225:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636305.689230:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689237:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636305.689241:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689248:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636305.689255:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636305.689261:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636305.689294:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689300:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636305.689326:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689333:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997ca00/0xa6aa59fb12fa7176 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa717d expref: -99 pid: 7608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689345:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636305.689348:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689353:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffa00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636305.689356:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689362:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636305.689368:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636305.689373:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636305.689385:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689390:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636305.689396:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689402:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa70ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa70b2 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689410:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636305.689418:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689424:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffe00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636305.689427:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689433:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636305.689439:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636305.689445:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636305.689459:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689465:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636305.689478:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689485:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7049 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7050 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.689497:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636305.689499:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636305.689501:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636305.689514:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976355456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636305.689546:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636305.689821:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875520976355072:0@lo:104: 00000100:00100000:1.0:1788636305.689833:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5df100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875520976355200:0@lo:104: 00000100:00100000:1.0:1788636305.689840:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5df480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875520976355328:0@lo:104: 00000100:00100000:1.0:1788636305.689866:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636305.689875:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976355712:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636305.689900:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636305.689988:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636305.689996:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976355584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636305.690027:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636305.690051:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976355456 00000100:00100000:0.0:1788636305.690056:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976355456 00010000:00010000:0.0:1788636305.690076:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 19 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636305.690095:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976355712 00000100:00100000:0.0:1788636305.690098:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976355712 00010000:00010000:0.0:1788636305.690108:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7050 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 20 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636305.690118:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976355584 00000100:00100000:0.0:1788636305.690121:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976355584 00010000:00010000:0.0:1788636305.690129:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 21 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636305.690141:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636305.690148:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+21:3282:x1875520976355456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636305.690158:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636305.690163:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 21 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690172:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 21 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690185:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40030e00/0xa6aa59fb12fa717d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7176 expref: 21 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690199:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636305.690226:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+20:3282:x1875520976355456:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636305.690242:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788636305.690257:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636305.690263:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976355712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636305.690270:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636305.690274:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7050 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 19 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690283:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7050 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 19 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690293:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7050 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7049 expref: 19 pid: 5804 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690301:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636305.690322:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+18:3281:x1875520976355712:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636305.690328:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636305.690339:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636305.690344:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+17:3282:x1875520976355584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636305.690351:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636305.690355:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 17 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690364:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 17 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690374:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa70b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa70ab expref: 17 pid: 5805 timeout: 324 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.690393:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636305.690415:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:1196c107-eaca-4490-96fc-d60d67da8edc+16:3282:x1875520976355584:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636305.690421:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788636305.690902:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a282300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976355712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636305.691085:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636305.691180:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a280000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976355584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636305.691190:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976355456:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636305.701140:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636305.701232:0:8489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8489:1875520976354944:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636305.701269:0:8489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636305.707482:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963745408 00000100:00100000:0.0:1788636305.707500:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963745408 00010000:00010000:0.0:1788636305.707545:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 10 pid: 5804 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636305.707640:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:0.0:1788636305.707649:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003dba47-3849-46de-b5b5-7b33358ec353+10:2363:x1875520963745408:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636305.707663:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636305.707669:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 10 pid: 5804 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707682:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 10 pid: 5804 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707700:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa723a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155433 expref: 10 pid: 5804 timeout: 274 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707717:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707725:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707768:0:5796:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707775:0:5796:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707791:0:5796:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707821:0:5796:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707828:0:5796:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167d600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636305.707832:0:5796:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707841:0:5796:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707861:0:5796:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636305.707872:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636305.708068:0:8489:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.708077:0:8489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636305.708083:0:8489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72db lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636305.710086:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003dba47-3849-46de-b5b5-7b33358ec353+9:2363:x1875520963745408:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 2430us (8946us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636305.710099:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 24 00010000:00010000:0.0:1788636305.983153:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636306.047617:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976355840:0@lo:400:kworker.0 00000100:00100000:1.0:1788636306.047692:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636306.047876:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976356224:0@lo:400:kworker.0 00000100:00100000:3.0:1788636306.047912:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636306.047972:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976356096:0@lo:400:kworker.0 00000100:00100000:3.0:1788636306.048027:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636306.048048:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636306.048053:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976355968:0@lo:400:kworker.0 00000100:00100000:3.0:1788636306.048086:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636306.048144:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976356096 00000100:00100000:3.0:1788636306.048151:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976356096 00000100:00100000:3.0:1788636306.048195:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976355968 00000100:00100000:3.0:1788636306.048198:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976355968 00000100:00100000:3.0:1788636306.048227:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636306.048237:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976356096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636306.048284:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976356096:12345-0@lo:400:kworker.0 Request processed in 48us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636306.048290:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636306.048305:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636306.048311:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976355968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636306.048491:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976355840 00000100:00100000:0.0:1788636306.048496:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976355840 00000100:00100000:0.0:1788636306.048524:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788636306.048537:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:3281:x1875520976355840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636306.048601:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976355968:12345-0@lo:400:kworker.0 Request processed in 289us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636306.048607:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636306.048647:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976355968:0@lo:400:kworker.0 00000100:00100000:3.0:1788636306.048657:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976356096:0@lo:400:kworker.0 00000100:00080000:3.0:1788636306.048686:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636306.048701:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976356224 00000100:00100000:3.0:1788636306.048704:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976356224 00000100:00100000:3.0:1788636306.048732:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636306.048738:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976356224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636306.048772:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976356224:12345-0@lo:400:kworker.0 Request processed in 35us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636306.048816:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1788636306.048839:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636306.048858:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5d8e00 x1875520976356224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636306.048868:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976356224:0@lo:400:kworker.0 00000100:00100000:2.0:1788636306.049732:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976356480:0@lo:400:kworker.0 00000100:00100000:2.0:1788636306.049771:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636306.049828:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976356480 00000100:00100000:2.0:1788636306.049833:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976356480 00000100:00100000:2.0:1788636306.049866:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788636306.049874:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976356480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636306.049911:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976356480:12345-0@lo:400:kworker.0 Request processed in 38us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636306.049930:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636306.050139:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:3281:x1875520976355840:12345-0@lo:400:kworker.0 Request processed in 1601us (2445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636306.050147:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00010000:00080000:2.0:1788636306.051873:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5d8000 x1875520976356480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636322 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636306.051887:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976356480:0@lo:400:kworker.0 00000100:00080000:3.0:1788636306.052129:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636306.052139:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636306.052154:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976356352:0@lo:400:kworker.0 00000100:00100000:3.0:1788636306.052211:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636306.052926:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976356352 00000100:00100000:2.0:1788636306.052933:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976356352 00000100:00100000:2.0:1788636306.053137:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636306.053147:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976356352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636306.053210:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976356352:12345-0@lo:400:kworker.0 Request processed in 64us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636306.053309:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976355840:0@lo:400:kworker.0 00000100:00080000:3.0:1788636306.053502:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636306.053533:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976356352:0@lo:400:kworker.0 00000100:00100000:2.0:1788636306.053759:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788636306.248325:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636306.248624:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963745536 00000100:00100000:1.0:1788636306.248635:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963745536 00000100:00100000:1.0:1788636306.248712:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 171 00000100:00100000:1.0:1788636306.248723:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+9:5600:x1875520963745536:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636306.248755:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636306.248786:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155472 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636306.248849:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636306.248860:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636306.248870:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167d600, rc 0) 00000100:00100000:1.0:1788636306.248941:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:5600:x1875520963745536:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 Request processed in 220us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636306.248948:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 171 00000100:00100000:2.0:1788636306.256189:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636306.257128:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963745664 00000100:00100000:3.0:1788636306.257138:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963745664 00000100:00100000:3.0:1788636306.257189:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 172 00000100:00100000:3.0:1788636306.257199:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:5600:x1875520963745664:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636306.257452:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:5600:x1875520963745664:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 Request processed in 253us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636306.257460:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 172 00000100:00100000:0.0:1788636306.277997:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636306.278177:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963745792 00000100:00100000:3.0:1788636306.278186:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963745792 00000100:00100000:3.0:1788636306.278240:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 173 00000100:00100000:3.0:1788636306.278251:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:5600:x1875520963745792:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636306.278459:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:5600:x1875520963745792:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 Request processed in 209us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636306.278475:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 173 00000100:00100000:0.0:1788636306.285812:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636306.285853:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963745920 00000100:00100000:1.0:1788636306.285862:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963745920 00000100:00100000:1.0:1788636306.285921:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 174 00000100:00100000:1.0:1788636306.285932:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:6137:x1875520963745920:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636306.286203:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:6137:x1875520963745920:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 273us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636306.286212:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 174 00000100:00100000:3.0:1788636306.293571:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636306.293656:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963746048 00000100:00100000:3.0:1788636306.293680:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963746048 00000100:00100000:3.0:1788636306.293759:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 175 00000100:00100000:3.0:1788636306.293770:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:6137:x1875520963746048:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636306.294424:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:6137:x1875520963746048:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 650us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636306.294434:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 175 00000100:00100000:3.0:1788636306.563370:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976356608:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636306.563466:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636306.563598:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976356608 00000100:00100000:0.0:1788636306.563607:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976356608 00000100:00100000:0.0:1788636306.563686:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788636306.563696:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976356608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636306.563734:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636306.563792:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976356608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636306.563822:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:3.0:1788636306.564943:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5de680 x1875520976356608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636322 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636306.564967:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976356608:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788636307.009540:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788636307.519142:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636307.519149:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613ba800 from 4 10000000:01000000:2.0:1788636307.519154:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636307.519204:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.519216:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.519228:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636307.521406:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976356736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.521690:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636307.521907:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976356736 00000100:00100000:3.0:1788636307.521916:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976356736 00000100:00100000:3.0:1788636307.521967:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788636307.521975:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976356736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636307.521989:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636307.522158:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa72e9 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636307.522182:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636307.522208:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636307.522217:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636307.523507:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976356736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1527us (1813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636307.523517:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788636307.526372:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.526419:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976356736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636307.526446:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.526458:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636307.526959:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976356864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.527014:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.527049:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f540 going to sleep for 11 seconds 00000100:00100000:3.0:1788636307.527349:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976356864 00000100:00100000:3.0:1788636307.527355:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976356864 00000100:00100000:3.0:1788636307.527454:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788636307.527465:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976356864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636307.527745:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976356864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 282us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636307.527753:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788636307.527836:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976356864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.527868:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976356992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.527909:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.531848:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636307.532018:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976356992 00000100:00100000:0.0:1788636307.532027:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976356992 00000100:00100000:0.0:1788636307.532073:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788636307.532083:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976356992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636307.532314:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976356992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 232us (4404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636307.532322:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788636307.532440:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976356992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.554322:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8570:1875520976357120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636307.554406:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.554449:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636307.554692:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976357120 00000100:00100000:3.0:1788636307.554702:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976357120 00000100:00100000:3.0:1788636307.554775:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788636307.554786:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:8570:x1875520976357120:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636307.555069:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:8570:x1875520976357120:12345-0@lo:502:llog_process_th.0 Request processed in 285us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636307.555077:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788636307.555124:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8570:1875520976357120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636307.555153:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636307.555162:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636307.555164:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788636307.555170:0:8570:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd613ba800 00000020:00000080:2.0:1788636307.555173:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788636307.556637:0:8570:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8570:1875520976357248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636307.556717:0:8570:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.556761:0:8570:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636307.556858:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976357248 00000100:00100000:3.0:1788636307.556866:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976357248 00000100:00100000:3.0:1788636307.556927:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788636307.556937:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+17:8570:x1875520976357248:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636307.557146:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+17:8570:x1875520976357248:12345-0@lo:502:llog_process_th.0 Request processed in 210us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636307.557154:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788636307.557250:0:8570:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8570:1875520976357248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636307.557275:0:8570:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636307.557282:0:8570:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636307.557284:0:8570:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788636307.557297:0:8570:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788636307.557669:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788636307.557689:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636307.557699:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636307.557711:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636307.557733:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788636307.557736:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd76a12000 from 4 10000000:01000000:3.0:1788636307.557738:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636307.557774:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636307.557783:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636307.557792:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636307.557828:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976357376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636307.557860:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636307.557884:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9470c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.558040:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976357376 00000100:00100000:2.0:1788636307.558047:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976357376 00000100:00100000:2.0:1788636307.558080:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788636307.558089:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976357376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636307.558099:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636307.558112:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa72f7 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.558137:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.558148:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.558157:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe800, rc 0) 00000100:00100000:2.0:1788636307.558200:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976357376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 112us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636307.558207:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1788636307.559187:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976357376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636307.559204:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636307.559214:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636307.559937:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976357504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636307.560370:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636307.560467:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd79f683c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.570831:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976357504 00000100:00100000:2.0:1788636307.570851:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976357504 00000100:00100000:2.0:1788636307.570917:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788636307.570927:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976357504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.571281:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976357504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 354us (10910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636307.571290:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1788636307.571357:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a281880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976357504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.571415:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976357632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.571467:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.571672:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.571688:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976357632 00000100:00100000:2.0:1788636307.571693:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976357632 00000100:00100000:2.0:1788636307.571891:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788636307.571900:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976357632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.572083:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976357632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636307.572090:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788636307.572145:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976357632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.576044:0:8574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8574:1875520976357760:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636307.576128:0:8574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.576167:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976357760 00000100:00100000:2.0:1788636307.576174:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976357760 00000100:00100000:2.0:1788636307.576213:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788636307.576221:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:8574:x1875520976357760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636307.577262:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:8574:x1875520976357760:12345-0@lo:502:llog_process_th.0 Request processed in 1037us (1130us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636307.577272:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788636307.577346:0:8574:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.577369:0:8574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8574:1875520976357760:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636307.577401:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636307.577411:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636307.577413:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788636307.577420:0:8574:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd76a12000 00000020:00000080:2.0:1788636307.577422:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788636307.577514:0:8574:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8574:1875520976357888:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636307.577555:0:8574:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.577580:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976357888 00000100:00100000:2.0:1788636307.577585:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976357888 00000100:00100000:2.0:1788636307.577616:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788636307.577624:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:8574:x1875520976357888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636307.577938:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:8574:x1875520976357888:12345-0@lo:502:llog_process_th.0 Request processed in 313us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636307.577945:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1788636307.578003:0:8574:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.578016:0:8574:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8574:1875520976357888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636307.578035:0:8574:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636307.578040:0:8574:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636307.578042:0:8574:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788636307.578046:0:8574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788636307.578102:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788636307.578119:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636307.578129:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.578139:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636307.578159:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636307.578162:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613a5000 from 4 10000000:01000000:2.0:1788636307.578165:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636307.578190:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.578197:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.578206:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636307.578219:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976358016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.578263:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.578282:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.578296:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976358016 00000100:00100000:2.0:1788636307.578299:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976358016 00000100:00100000:2.0:1788636307.578324:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788636307.578331:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976358016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636307.578339:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636307.578352:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7305 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.578372:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.578383:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.578404:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ffe00, rc 0) 00000100:00100000:2.0:1788636307.578434:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976358016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636307.578440:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:2.0:1788636307.579085:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976358016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636307.579101:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636307.579111:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636307.579164:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976358144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.579196:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.579216:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.579233:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976358144 00000100:00100000:2.0:1788636307.579380:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976358144 00000100:00100000:2.0:1788636307.579411:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788636307.579419:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976358144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.579651:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976358144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 232us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636307.579658:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1788636307.579690:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976358144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.579881:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976358272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.579921:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636307.579944:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125f540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636307.580016:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976358272 00000100:00100000:2.0:1788636307.580020:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976358272 00000100:00100000:2.0:1788636307.580042:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788636307.580047:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976358272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636307.580200:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976358272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 151us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636307.580207:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1788636307.580316:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976358272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636307.581947:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8577:1875520976358400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636307.582039:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636307.582074:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976358400 00000100:00100000:1.0:1788636307.582080:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976358400 00000100:00100000:1.0:1788636307.582117:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788636307.582125:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:8577:x1875520976358400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636307.583852:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:8577:x1875520976358400:12345-0@lo:502:llog_process_th.0 Request processed in 1718us (1805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636307.583865:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1788636307.583933:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636307.583957:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8577:1875520976358400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636307.583989:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636307.584000:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636307.584003:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788636307.584012:0:8577:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd613a5000 00000020:00000080:1.0:1788636307.584015:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788636307.585872:0:8577:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8577:1875520976358528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636307.585940:0:8577:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636307.585982:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976358528 00000100:00100000:1.0:1788636307.585989:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976358528 00000100:00100000:1.0:1788636307.586033:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788636307.586042:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:8577:x1875520976358528:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636307.586232:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:8577:x1875520976358528:12345-0@lo:502:llog_process_th.0 Request processed in 191us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636307.588403:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1788636307.588498:0:8577:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd780 going to sleep for 11 seconds 00000100:00100000:1.0:1788636307.588533:0:8577:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5df480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:8577:1875520976358528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636307.590072:0:8577:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636307.590084:0:8577:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636307.590087:0:8577:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788636307.590094:0:8577:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788636307.590175:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788636307.590207:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636307.590219:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636307.590231:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636308.033246:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636308.041214:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636308.041301:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636308.041386:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636308.041424:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636308.041458:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963746432 00000100:00100000:0.0:1788636308.041467:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963746432 00000100:00100000:0.0:1788636308.041533:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963746560 00000100:00100000:0.0:1788636308.041537:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963746560 00000100:00100000:0.0:1788636308.041580:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:0.0:1788636308.041591:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963746432:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636308.041658:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963746432:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 69us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636308.041665:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:0.0:1788636308.041683:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:0.0:1788636308.041689:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963746560:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636308.041715:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963746560:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 27us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636308.041739:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:2.0:1788636308.041847:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963746304 00000100:00100000:2.0:1788636308.041851:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963746304 00000100:00080000:3.0:1788636308.041895:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636308.041900:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636308.041903:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636308.041960:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:2.0:1788636308.041969:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963746304:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636308.041999:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963746304:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 31us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636308.042006:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:1.0:1788636308.042427:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963746176 00000100:00100000:1.0:1788636308.042437:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963746176 00000100:00100000:1.0:1788636308.042477:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 191 00000100:00100000:1.0:1788636308.042485:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:2361:x1875520963746176:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636308.042905:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:2361:x1875520963746176:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 419us (1699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636308.042913:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 191 00000100:00100000:0.0:1788636308.095703:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636308.095736:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976358656:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636308.095847:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636308.100550:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976358656 00000100:00100000:3.0:1788636308.100575:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976358656 00000100:00100000:3.0:1788636308.100647:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788636308.100659:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976358656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636308.100697:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788636308.100706:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636308.100860:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976358656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (5011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636308.100876:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1788636308.101054:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c8380 x1875520976358656/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636324 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636308.101078:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976358656:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788636309.061657:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636310.078994:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636311.104089:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636311.167083:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976359168:0@lo:400:kworker.0 00000100:00100000:2.0:1788636311.167145:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636311.167203:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788636311.167209:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976358784:0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.167490:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976359040:0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.167522:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636311.167543:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788636311.167548:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976358912:0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.167568:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636311.167584:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976359424:0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.167603:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636311.167639:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976359040 00000100:00100000:3.0:1788636311.167647:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976359040 00000100:00100000:3.0:1788636311.167690:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976358912 00000100:00100000:3.0:1788636311.167694:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976358912 00000100:00100000:3.0:1788636311.167715:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788636311.167723:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976359040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.167782:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976359040:12345-0@lo:400:kworker.0 Request processed in 60us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636311.167789:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788636311.167824:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788636311.167830:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976358912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.167871:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976358912:12345-0@lo:400:kworker.0 Request processed in 41us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636311.167886:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788636311.167905:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976359168 00000100:00100000:3.0:1788636311.167908:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976359168 00000100:00100000:3.0:1788636311.167932:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976359424 00000100:00100000:3.0:1788636311.167935:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976359424 00000100:00100000:3.0:1788636311.167955:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636311.167961:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976359168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.167994:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976359168:12345-0@lo:400:kworker.0 Request processed in 33us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636311.168000:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788636311.168011:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636311.168017:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976359424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.168042:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976359424:12345-0@lo:400:kworker.0 Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636311.168048:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636311.168087:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976358912:0@lo:400:kworker.0 00010000:00080000:3.0:1788636311.168100:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5dbb80 x1875520976359424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636311.168111:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976359424:0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.168119:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976359040:0@lo:400:kworker.0 00000100:00080000:3.0:1788636311.168160:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636311.168163:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636311.168166:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636311.168739:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636311.168805:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976359296:0@lo:400:kworker.0 00000100:00100000:2.0:1788636311.168833:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788636311.168868:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5dad80 x1875520976359168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636327 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636311.168887:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976359168:0@lo:400:kworker.0 00000100:00100000:2.0:1788636311.168909:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976359296 00000100:00100000:2.0:1788636311.168913:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976359296 00000100:00100000:2.0:1788636311.168943:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788636311.168949:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976359296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636311.168984:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976359296:12345-0@lo:400:kworker.0 Request processed in 35us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636311.168989:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788636311.169005:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636311.169020:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976359296:0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.169643:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976358784 00000100:00100000:3.0:1788636311.169648:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976358784 00000100:00100000:3.0:1788636311.169690:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1788636311.169696:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976358784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636311.169733:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976358784:12345-0@lo:400:kworker.0 Request processed in 38us (2481us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636311.169739:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1788636311.169944:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976358784:0@lo:400:kworker.0 00000001:02000400:1.0:1788636311.607485:0:8787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:3.0:1788636311.680888:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976359552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636311.680958:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636311.681888:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976359552 00000100:00100000:1.0:1788636311.681895:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976359552 00000100:00100000:1.0:1788636311.681934:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788636311.681941:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976359552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636311.681970:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636311.682012:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976359552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636311.682017:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788636311.682048:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612cad80 x1875520976359552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636311.682061:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976359552:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788636312.127986:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636313.153959:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636313.165238:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636313.165282:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636313.165318:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636313.165407:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963746816 00000100:00100000:3.0:1788636313.165417:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963746816 00000100:00100000:3.0:1788636313.165483:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:3.0:1788636313.165493:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963746816:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636313.165553:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963746816:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 62us (270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636313.165560:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:2.0:1788636313.165871:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963747072 00000100:00100000:2.0:1788636313.165876:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963747072 00000100:00100000:2.0:1788636313.165911:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:2.0:1788636313.165919:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963747072:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636313.165956:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963747072:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 38us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636313.165975:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00080000:0.0:1788636313.166390:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636313.166396:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636313.166452:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963746688 00000100:00100000:1.0:1788636313.166457:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963746688 00000100:00100000:1.0:1788636313.166496:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 193 00000100:00100000:1.0:1788636313.166504:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:2361:x1875520963746688:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636313.166547:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:2361:x1875520963746688:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 44us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636313.166554:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 193 00000100:00100000:3.0:1788636313.172355:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636313.173055:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963746944 00000100:00100000:0.0:1788636313.173065:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963746944 00000100:00100000:0.0:1788636313.173142:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:0.0:1788636313.173152:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963746944:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636313.173230:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963746944:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 80us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636313.173238:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00080000:2.0:1788636313.173305:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636313.215150:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636313.215175:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976359680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636313.215242:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636313.215407:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976359680 00000100:00100000:3.0:1788636313.215416:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976359680 00000100:00100000:3.0:1788636313.215479:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788636313.215488:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976359680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636313.215521:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636313.215567:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976359680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636313.215574:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1788636313.215671:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636313.215700:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612ca300 x1875520976359680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636329 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636313.215721:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976359680:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788636314.176654:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636315.198960:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636316.225449:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636316.287216:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976360192:0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.287304:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636316.287365:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788636316.287373:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976359808:0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.287403:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636316.287426:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976360320:0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.287451:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636316.287479:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976359936:0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.287503:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636316.287529:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976360448:0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.287551:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636316.287568:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636316.287573:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976360064:0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.287594:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636316.287626:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976360192 00000100:00100000:0.0:1788636316.287632:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976360192 00000100:00100000:0.0:1788636316.287679:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976360448 00000100:00100000:0.0:1788636316.287683:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976360448 00000100:00100000:0.0:1788636316.287719:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636316.287729:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976360192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.287780:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976360192:12345-0@lo:400:kworker.0 Request processed in 52us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636316.287788:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636316.287963:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636316.287971:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976360448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.288053:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976360448:12345-0@lo:400:kworker.0 Request processed in 83us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636316.288060:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636316.288078:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976359808 00000100:00100000:0.0:1788636316.288082:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976359808 00000100:00100000:0.0:1788636316.288108:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788636316.288114:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976359808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.288146:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976359808:12345-0@lo:400:kworker.0 Request processed in 32us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636316.288152:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1788636316.288179:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976360320 00000100:00100000:0.0:1788636316.288190:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976360320 00000100:00100000:0.0:1788636316.288219:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976359936 00000100:00100000:0.0:1788636316.288222:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976359936 00000100:00100000:0.0:1788636316.288233:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976360064 00000100:00100000:0.0:1788636316.288235:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976360064 00000100:00100000:0.0:1788636316.288250:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788636316.288255:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976360320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.288288:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976360320:12345-0@lo:400:kworker.0 Request processed in 32us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636316.288294:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788636316.288305:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788636316.288311:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976359936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.288338:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976359936:12345-0@lo:400:kworker.0 Request processed in 27us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636316.288343:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788636316.288354:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788636316.288360:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976360064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.288385:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976360064:12345-0@lo:400:kworker.0 Request processed in 26us (791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636316.288391:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:0.0:1788636316.288417:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636316.288423:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636316.288425:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636316.288464:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976359808:0@lo:400:kworker.0 00000100:00100000:0.0:1788636316.288478:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976360320:0@lo:400:kworker.0 00010000:00080000:0.0:1788636316.288490:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75cfed80 x1875520976360192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636316.288515:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976360192:0@lo:400:kworker.0 00010000:00080000:2.0:1788636316.288733:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75cfd500 x1875520976360448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636332 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636316.288743:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976360448:0@lo:400:kworker.0 00000100:00100000:2.0:1788636316.288770:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976360064:0@lo:400:kworker.0 00000100:00100000:2.0:1788636316.288780:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976359936:0@lo:400:kworker.0 00000001:02000400:3.0:1788636316.786780:0:9031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing yml_node 00000100:00100000:1.0:1788636316.800014:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636316.800037:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976360576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636316.800105:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636316.800299:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976360576 00000100:00100000:3.0:1788636316.800307:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976360576 00000100:00100000:3.0:1788636316.800358:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788636316.800368:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976360576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636316.800401:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636316.800459:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5df100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976360576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636316.800466:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1788636316.800561:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c9f80 x1875520976360576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636316.800580:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976360576:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788636317.247922:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636318.271075:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636318.285252:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636318.285299:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636318.285390:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963747200 00000100:00100000:3.0:1788636318.285399:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963747200 00000100:00100000:3.0:1788636318.285463:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 195 00000100:00100000:3.0:1788636318.285475:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963747200:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636318.285548:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963747200:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 75us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636318.285556:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 195 00000100:00100000:0.0:1788636318.285851:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636318.285894:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636318.285918:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963747456 00000100:00100000:0.0:1788636318.285922:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963747456 00000100:00100000:3.0:1788636318.285947:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963747584 00000100:00100000:3.0:1788636318.285951:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963747584 00000100:00100000:0.0:1788636318.285960:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:0.0:1788636318.285966:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+5:2359:x1875520963747456:12345-192.168.203.57@tcp:9:kworker.0 00000100:00100000:3.0:1788636318.285974:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:3.0:1788636318.285980:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2359:x1875520963747584:12345-192.168.203.57@tcp:9:kworker.0 00000020:00000080:0.0:1788636318.285990:0:6963:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7248 00000020:00000080:3.0:1788636318.285993:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa724f 00000100:00080000:3.0:1788636318.285999:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9cfd47fc0800 : changing import state from FULL to CLOSED 00000100:00080000:0.0:1788636318.285999:0:6963:0:(import.c:65:import_set_state_nolock()) ffff9cfd7a53b800 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1788636318.286078:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636318.286083:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:0.0:1788636318.286162:0:6963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788636318.286412:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963747328 00000100:00100000:2.0:1788636318.286417:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963747328 00000100:00100000:2.0:1788636318.286451:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:2.0:1788636318.286458:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963747328:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636318.286469:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+2:2359:x1875520963747456:12345-192.168.203.57@tcp:9:kworker.0 Request processed in 502us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636318.286476:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:2.0:1788636318.286488:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963747328:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 31us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636318.286494:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 38 00000001:00000004:3.0:1788636318.286664:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:0.0:1788636318.286777:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636318.286898:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+2:2359:x1875520963747584:12345-192.168.203.57@tcp:9:kworker.0 Request processed in 916us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636318.286906:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00010000:00010000:2.0:1788636318.287161:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636318.287536:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636318.335188:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976360704:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636318.335263:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636318.336114:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976360704 00000100:00100000:1.0:1788636318.336124:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976360704 00000100:00100000:1.0:1788636318.336199:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788636318.336210:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976360704:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636318.336258:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788636318.336343:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636318.342571:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976360704:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6354us (7298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636318.342588:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788636318.344106:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c8e00 x1875520976360704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636334 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636318.344138:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976360704:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788636319.298002:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788636319.441501:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:0.0:1788636319.441509:0:6685:0:(genops.c:885:class_export_put()) final put ffff9cfd7a53a000/38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:1.0:1788636319.441604:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7a53a000/38630149-ece4-4de3-88b1-a62e16a39489 for lustre-OST0000 00000020:00000080:1.0:1788636319.441651:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd7a53b800 for lustre-OST0000 00010000:00010000:2.0:1788636320.319091:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788636321.152785:0:9224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.2 00010000:00010000:0.0:1788636321.344316:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636321.407338:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976360960:0@lo:400:kworker.0 00000100:00100000:1.0:1788636321.407417:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636321.407472:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976361472:0@lo:400:kworker.0 00000100:00100000:1.0:1788636321.407499:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636321.407532:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636321.407538:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976361088:0@lo:400:kworker.0 00000100:00100000:1.0:1788636321.407559:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636321.407585:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976361216:0@lo:400:kworker.0 00000100:00100000:1.0:1788636321.407610:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636321.407631:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788636321.407639:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976360832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636321.407640:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976360960 00000100:00100000:0.0:1788636321.407649:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976360960 00000100:00100000:1.0:1788636321.407689:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636321.407706:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976361088 00000100:00100000:0.0:1788636321.407710:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976361088 00000100:00100000:1.0:1788636321.407723:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976361344:0@lo:400:kworker.0 00000100:00100000:2.0:1788636321.407732:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636321.407747:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976360960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636321.407771:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636321.407820:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976361472 00000100:00100000:1.0:1788636321.407824:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976361472 00000100:00100000:1.0:1788636321.407855:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976361216 00000100:00100000:1.0:1788636321.407859:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976361216 00000100:00100000:0.0:1788636321.407869:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976361344 00000100:00100000:0.0:1788636321.407875:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976361344 00000100:00100000:1.0:1788636321.407889:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788636321.407902:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976361472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636321.407907:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788636321.407909:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976360960:12345-0@lo:400:kworker.0 Request processed in 162us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636321.407922:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976361088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636321.407926:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636321.407951:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788636321.407962:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976361344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636321.407974:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976361472:12345-0@lo:400:kworker.0 Request processed in 74us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636321.407981:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976361088:12345-0@lo:400:kworker.0 Request processed in 62us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636321.407992:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788636321.407997:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636321.408006:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976361344:12345-0@lo:400:kworker.0 Request processed in 46us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636321.408014:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1788636321.408026:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636321.408032:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00080000:0.0:1788636321.408034:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636321.408040:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636321.408043:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976360832 00000100:00100000:1.0:1788636321.408044:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976361216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636321.408048:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976360832 00000100:00100000:2.0:1788636321.408081:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788636321.408088:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976360832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636321.408127:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976360832:12345-0@lo:400:kworker.0 Request processed in 40us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636321.408134:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788636321.408179:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976360832:0@lo:400:kworker.0 00000100:00100000:2.0:1788636321.408192:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976361344:0@lo:400:kworker.0 00000100:00100000:2.0:1788636321.408222:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976361088:0@lo:400:kworker.0 00000100:00100000:2.0:1788636321.408233:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976360960:0@lo:400:kworker.0 00010000:00080000:2.0:1788636321.408245:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5dd500 x1875520976361472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636321.408254:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976361472:0@lo:400:kworker.0 00000100:00100000:1.0:1788636321.408392:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976361216:12345-0@lo:400:kworker.0 Request processed in 352us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636321.408400:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788636321.409662:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5dd880 x1875520976361216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636321.409689:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976361216:0@lo:400:kworker.0 00000100:00100000:1.0:1788636321.919098:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976361600:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636321.919182:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636321.919471:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976361600 00000100:00100000:0.0:1788636321.919480:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976361600 00000100:00100000:0.0:1788636321.919530:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788636321.919539:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976361600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636321.919573:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636321.919621:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a337800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976361600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636321.919628:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788636321.919716:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfc4222fb80 x1875520976361600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636321.919733:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976361600:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788636322.367126:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788636322.482232:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:3.0:1788636322.482243:0:7625:0:(genops.c:885:class_export_put()) final put ffff9cfd47fc3000/38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:0.0:1788636322.482325:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd47fc3000/38630149-ece4-4de3-88b1-a62e16a39489 for lustre-OST0001 00000020:00000080:0.0:1788636322.482440:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd47fc0800 for lustre-OST0001 00010000:00010000:3.0:1788636323.394624:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636323.399197:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636323.399303:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963747712 00000100:00100000:1.0:1788636323.399317:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963747712 00000100:00100000:1.0:1788636323.399380:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 197 00000100:00100000:1.0:1788636323.399392:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963747712:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636323.399490:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963747712:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 100us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636323.399498:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 197 00000100:00100000:2.0:1788636323.405519:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636323.405717:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963747840 00000100:00100000:3.0:1788636323.405739:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963747840 00000100:00100000:3.0:1788636323.405848:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:3.0:1788636323.405859:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963747840:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636323.405964:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963747840:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 107us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636323.405972:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00080000:1.0:1788636323.406185:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636323.456403:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976361728:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636323.456505:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636323.456646:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976361728 00000100:00100000:3.0:1788636323.456666:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976361728 00000100:00100000:3.0:1788636323.456749:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636323.456761:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976361728:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636323.456835:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636323.456908:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976361728:12345-0@lo:13:osp-pre-0-0.0 Request processed in 149us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636323.456917:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:3.0:1788636323.457127:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c8700 x1875520976361728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636339 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636323.457151:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976361728:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788636323.457257:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788636324.289224:0:9322:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.2 00010000:00010000:1.0:1788636324.415078:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636325.444459:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636326.463982:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636326.530935:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976361856:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531003:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636326.531048:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976362368:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531074:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636326.531099:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636326.531105:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976362240:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531128:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636326.531170:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976361984:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531194:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636326.531211:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976362496:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531231:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636326.531249:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636326.531254:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976362112:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531273:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636326.531302:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976361856 00000100:00100000:2.0:1788636326.531310:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976361856 00000100:00100000:2.0:1788636326.531351:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788636326.531360:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976361856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531407:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976361856:12345-0@lo:400:kworker.0 Request processed in 48us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636326.531414:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788636326.531444:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976362368 00000100:00100000:2.0:1788636326.531448:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976362368 00000100:00100000:2.0:1788636326.531481:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976361984 00000100:00100000:2.0:1788636326.531484:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976361984 00000100:00100000:2.0:1788636326.531496:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976362112 00000100:00100000:2.0:1788636326.531498:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976362112 00000100:00100000:2.0:1788636326.531513:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788636326.531519:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976362368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531549:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976362368:12345-0@lo:400:kworker.0 Request processed in 31us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636326.531555:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788636326.531565:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788636326.531570:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976361984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531610:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976361984:12345-0@lo:400:kworker.0 Request processed in 39us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636326.531616:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788636326.531627:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788636326.531633:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976362112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531673:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976362112:12345-0@lo:400:kworker.0 Request processed in 41us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636326.531679:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788636326.531696:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976362240 00000100:00100000:2.0:1788636326.531700:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976362240 00000100:00100000:2.0:1788636326.531725:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976362496 00000100:00100000:2.0:1788636326.531728:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976362496 00000100:00100000:2.0:1788636326.531746:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788636326.531752:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976362240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531778:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976362240:12345-0@lo:400:kworker.0 Request processed in 27us (649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636326.531783:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788636326.531793:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788636326.531821:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976362496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531846:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976362496:12345-0@lo:400:kworker.0 Request processed in 26us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636326.531852:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:2.0:1788636326.531879:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636326.531884:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636326.531886:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636326.531920:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976362112:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.531941:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976361984:0@lo:400:kworker.0 00010000:00080000:2.0:1788636326.531952:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5d8700 x1875520976362496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636326.531962:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976362496:0@lo:400:kworker.0 00010000:00080000:2.0:1788636326.531997:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5dbb80 x1875520976362240/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636326.532006:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976362240:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.532015:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976361856:0@lo:400:kworker.0 00000100:00100000:2.0:1788636326.532023:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976362368:0@lo:400:kworker.0 00000001:02000400:2.0:1788636326.957139:0:9420:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.2 00000100:00100000:0.0:1788636327.040331:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976362624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636327.040408:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636327.040861:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976362624 00000100:00100000:3.0:1788636327.040869:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976362624 00000100:00100000:3.0:1788636327.040934:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636327.040955:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976362624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636327.040989:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636327.041035:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976362624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636327.041280:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:3.0:1788636327.041329:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfc4222f800 x1875520976362624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636343 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636327.041351:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976362624:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788636327.487044:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636328.511599:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636328.531911:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636328.531953:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636328.532066:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963748096 00000100:00100000:3.0:1788636328.532075:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963748096 00000100:00100000:3.0:1788636328.532136:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:3.0:1788636328.532147:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963748096:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636328.532221:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963748096:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 76us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636328.532229:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00080000:3.0:1788636328.532250:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636328.532760:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963747968 00000100:00100000:0.0:1788636328.532766:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963747968 00000100:00100000:0.0:1788636328.532819:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 199 00000100:00100000:0.0:1788636328.532827:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963747968:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636328.532866:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963747968:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 41us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636328.532873:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 199 00000100:00100000:1.0:1788636328.575247:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636328.590831:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976362752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636328.590905:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636328.591212:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976362752 00000100:00100000:3.0:1788636328.591221:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976362752 00000100:00100000:3.0:1788636328.591281:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788636328.591290:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976362752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636328.591323:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636328.591378:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976362752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636328.591385:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1788636328.591678:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636328.591708:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c8700 x1875520976362752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636344 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636328.591730:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976362752:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1788636328.665184:0:9469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 15:25:27 EDT 2026 00010000:00010000:3.0:1788636329.535766:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636330.560558:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636331.582938:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636331.657500:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976363264:0@lo:400:kworker.0 00000100:00100000:2.0:1788636331.657529:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976362880:0@lo:400:kworker.0 00000100:00100000:2.0:1788636331.657568:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636331.657568:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636331.657670:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976363136:0@lo:400:kworker.0 00000100:00100000:1.0:1788636331.657849:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976363008:0@lo:400:kworker.0 00000100:00100000:1.0:1788636331.657877:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636331.657908:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976363520:0@lo:400:kworker.0 00000100:00100000:1.0:1788636331.657930:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636331.657978:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976363264 00000100:00100000:2.0:1788636331.657984:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976363392:0@lo:400:kworker.0 00000100:00100000:1.0:1788636331.657984:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976363264 00000100:00100000:2.0:1788636331.658008:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636331.658032:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976363520 00000100:00100000:2.0:1788636331.658034:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976362880 00000100:00100000:1.0:1788636331.658035:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976363520 00000100:00100000:2.0:1788636331.658036:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976362880 00000100:00100000:1.0:1788636331.658056:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636331.658058:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788636331.658064:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976362880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636331.658064:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976363264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636331.658107:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976362880:12345-0@lo:400:kworker.0 Request processed in 42us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636331.658107:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976363264:12345-0@lo:400:kworker.0 Request processed in 44us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636331.658114:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788636331.658115:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788636331.658142:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976363008 00000100:00100000:2.0:1788636331.658145:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976363008 00000100:00100000:2.0:1788636331.658181:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976363392 00000100:00100000:2.0:1788636331.658184:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976363392 00000100:00100000:2.0:1788636331.658203:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788636331.658209:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976363008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636331.658244:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976363008:12345-0@lo:400:kworker.0 Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636331.658250:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788636331.658261:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788636331.658267:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976363392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636331.658293:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976363392:12345-0@lo:400:kworker.0 Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636331.658298:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788636331.658317:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636331.658323:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976363520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636331.658364:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976363520:12345-0@lo:400:kworker.0 Request processed in 41us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636331.658369:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636331.658419:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976363008:0@lo:400:kworker.0 00010000:00080000:2.0:1788636331.658433:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6a336a00 x1875520976363520/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636331.658442:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976363520:0@lo:400:kworker.0 00000100:00100000:2.0:1788636331.658476:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976362880:0@lo:400:kworker.0 00000100:00100000:2.0:1788636331.658499:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976363392:0@lo:400:kworker.0 00000100:00080000:1.0:1788636331.658694:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636331.658699:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636331.658701:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636331.658742:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6a335180 x1875520976363264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636331.658752:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976363264:0@lo:400:kworker.0 00000100:00100000:3.0:1788636331.666851:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636331.667070:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976363136 00000100:00100000:1.0:1788636331.667080:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976363136 00000100:00080000:3.0:1788636331.667204:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636331.667254:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788636331.667264:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976363136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636331.667331:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976363136:12345-0@lo:400:kworker.0 Request processed in 70us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636331.667338:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788636331.667412:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976363136:0@lo:400:kworker.0 00000100:00100000:2.0:1788636332.161978:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636332.162013:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976363648:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636332.162082:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636332.162270:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976363648 00000100:00100000:0.0:1788636332.162279:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976363648 00000100:00100000:0.0:1788636332.162335:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636332.162345:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976363648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636332.162383:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636332.162473:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976363648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636332.162481:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788636332.169778:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfc4222c380 x1875520976363648/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636332.169836:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976363648:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788636332.607725:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636333.634356:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636333.645918:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636333.645963:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636333.646021:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963748224 00000100:00100000:1.0:1788636333.646035:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963748224 00000100:00100000:1.0:1788636333.646104:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 201 00000100:00100000:1.0:1788636333.646115:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:2361:x1875520963748224:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636333.646205:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:2361:x1875520963748224:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 91us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636333.646214:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 201 00000100:00100000:1.0:1788636333.646250:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963748352 00000100:00100000:1.0:1788636333.646254:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963748352 00000100:00100000:1.0:1788636333.646294:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:1.0:1788636333.646301:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963748352:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636333.646332:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963748352:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 32us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636333.646338:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00080000:3.0:1788636333.646383:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636333.703872:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788636333.703906:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976363776:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636333.704004:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636333.712532:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976363776 00000100:00100000:0.0:1788636333.712555:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976363776 00000100:00080000:0.0:1788636333.713043:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636333.713118:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788636333.713131:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976363776:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636333.713183:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636333.713296:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976363776:12345-0@lo:13:osp-pre-0-0.0 Request processed in 168us (9292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636333.713303:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788636333.713365:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfc4222f100 x1875520976363776/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636349 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636333.713394:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976363776:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788636334.658018:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636335.679046:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636336.703627:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636336.767547:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976364032:0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.767650:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636336.767724:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976364544:0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.767751:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636336.767787:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636336.767823:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976364160:0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.767849:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636336.767889:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976364544 00000100:00100000:2.0:1788636336.767899:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976364544 00000100:00100000:2.0:1788636336.767972:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636336.767984:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976364544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.768043:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976364544:12345-0@lo:400:kworker.0 Request processed in 62us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636336.768065:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636336.768094:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976364032 00000100:00100000:2.0:1788636336.768098:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976364032 00000100:00100000:2.0:1788636336.768120:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976364160 00000100:00100000:2.0:1788636336.768131:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976364160 00000100:00100000:2.0:1788636336.768155:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788636336.768161:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976364032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.768203:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976364032:12345-0@lo:400:kworker.0 Request processed in 32us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636336.768209:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788636336.768220:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788636336.768226:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976364160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.768250:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976364160:12345-0@lo:400:kworker.0 Request processed in 25us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636336.768256:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788636336.768298:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976364160:0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.768308:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976364032:0@lo:400:kworker.0 00010000:00080000:2.0:1788636336.768319:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7eef8000 x1875520976364544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636336.768330:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976364544:0@lo:400:kworker.0 00000100:00100000:0.0:1788636336.768545:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976363904:0@lo:400:kworker.0 00000100:00100000:0.0:1788636336.768600:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636336.768635:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976364416:0@lo:400:kworker.0 00000100:00100000:0.0:1788636336.768659:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636336.768683:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636336.768689:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976364288:0@lo:400:kworker.0 00000100:00100000:0.0:1788636336.768712:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788636336.768740:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636336.768745:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636336.768757:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976364288 00000100:00100000:0.0:1788636336.768761:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976364288 00000100:00100000:0.0:1788636336.768821:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788636336.768828:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976364288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636336.768867:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976364288:12345-0@lo:400:kworker.0 Request processed in 40us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636336.768873:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:0.0:1788636336.768887:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636336.768903:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976364416 00000100:00100000:0.0:1788636336.768906:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976364416 00000100:00100000:0.0:1788636336.768926:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636336.768932:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976364416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636336.768960:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976364416:12345-0@lo:400:kworker.0 Request processed in 28us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636336.768965:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1788636336.768977:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788636336.768995:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f5dad80 x1875520976364288/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636352 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636336.769006:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976364288:0@lo:400:kworker.0 00000100:00100000:0.0:1788636336.769017:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976364416:0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.771262:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976363904 00000100:00100000:2.0:1788636336.771280:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976363904 00000100:00100000:2.0:1788636336.771405:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788636336.771429:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976363904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636336.771539:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976363904:12345-0@lo:400:kworker.0 Request processed in 124us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636336.771547:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788636336.771642:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976363904:0@lo:400:kworker.0 00000100:00100000:1.0:1788636337.285431:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636337.285459:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976364672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636337.285558:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636337.285976:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976364672 00000100:00100000:0.0:1788636337.285987:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976364672 00000100:00100000:0.0:1788636337.286051:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788636337.286061:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976364672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636337.286105:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636337.286221:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976364672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636337.286229:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788636337.287117:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfc4222d180 x1875520976364672/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636337.287159:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976364672:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788636337.730059:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636338.757862:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636338.762088:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636338.766702:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963748480 00000100:00100000:0.0:1788636338.766719:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963748480 00000100:00100000:0.0:1788636338.766788:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 203 00000100:00100000:0.0:1788636338.766819:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963748480:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636338.766924:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963748480:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 126us (4845us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636338.766932:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 203 00000100:00100000:1.0:1788636338.777529:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636338.777624:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963748608 00000100:00100000:0.0:1788636338.777634:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963748608 00000100:00100000:0.0:1788636338.777715:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00100000:0.0:1788636338.777726:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963748608:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636338.777817:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963748608:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 71us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636338.777824:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00080000:1.0:1788636338.778239:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636338.818122:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636338.818144:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976364800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636338.818219:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636338.818288:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976364800 00000100:00100000:3.0:1788636338.818296:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976364800 00000100:00100000:3.0:1788636338.818356:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636338.818365:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976364800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636338.818403:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636338.818448:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976364800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636338.818456:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788636338.818495:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c9500 x1875520976364800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636354 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636338.818516:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976364800:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788636338.818549:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788636339.775113:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636340.804072:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636341.824783:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636341.895116:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976364928:0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.895186:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636341.897365:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976365440:0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.897426:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636341.897472:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636341.897479:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976365312:0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.897504:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636341.897548:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976365056:0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.897573:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636341.897592:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976365568:0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.897614:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636341.897633:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636341.897761:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976365184:0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.897820:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636341.897927:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976364928 00000100:00100000:0.0:1788636341.897936:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976364928 00000100:00100000:0.0:1788636341.897982:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788636341.897991:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976364928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.898044:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976364928:12345-0@lo:400:kworker.0 Request processed in 54us (2857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636341.898051:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1788636341.898082:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976365440 00000100:00100000:0.0:1788636341.898086:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976365440 00000100:00100000:0.0:1788636341.898128:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976365056 00000100:00100000:0.0:1788636341.898132:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976365056 00000100:00100000:0.0:1788636341.898144:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976365184 00000100:00100000:0.0:1788636341.898147:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976365184 00000100:00100000:0.0:1788636341.898162:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788636341.898167:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976365440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.898200:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976365440:12345-0@lo:400:kworker.0 Request processed in 32us (774us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636341.898206:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788636341.898724:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636341.898733:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976365056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.898776:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976365056:12345-0@lo:400:kworker.0 Request processed in 44us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636341.898782:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636341.898815:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636341.898823:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976365184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.899317:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976365184:12345-0@lo:400:kworker.0 Request processed in 495us (1495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636341.899706:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636341.899735:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976365312 00000100:00100000:0.0:1788636341.899741:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976365312 00000100:00100000:0.0:1788636341.899908:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976365568 00000100:00100000:0.0:1788636341.899913:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976365568 00000100:00080000:3.0:1788636341.904774:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636341.904785:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636341.904789:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636341.907378:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636341.907399:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976365312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636341.907486:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976365312:12345-0@lo:400:kworker.0 Request processed in 97us (9981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636341.907493:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636341.907518:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788636341.907526:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976365568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636341.907565:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976365568:12345-0@lo:400:kworker.0 Request processed in 41us (9951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636341.907571:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788636341.912994:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976365184:0@lo:400:kworker.0 00000100:00100000:0.0:1788636341.913014:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976365056:0@lo:400:kworker.0 00010000:00080000:0.0:1788636341.913029:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75cfc700 x1875520976365568/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636341.913039:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976365568:0@lo:400:kworker.0 00010000:00080000:2.0:1788636341.913475:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfc4222f800 x1875520976365312/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636357 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636341.913487:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976365312:0@lo:400:kworker.0 00000100:00100000:2.0:1788636341.913503:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976364928:0@lo:400:kworker.0 00000100:00100000:2.0:1788636341.913516:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976365440:0@lo:400:kworker.0 00000100:00100000:2.0:1788636342.399705:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976365696:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636342.399783:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636342.399923:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976365696 00000100:00100000:3.0:1788636342.399943:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976365696 00000100:00100000:3.0:1788636342.399992:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636342.400002:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976365696:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636342.400037:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636342.400622:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976365696:12345-0@lo:13:osp-pre-1-0.0 Request processed in 618us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636342.400691:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788636342.401245:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75cfc700 x1875520976365696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636342.401437:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75cfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976365696:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636342.847590:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636343.873441:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636343.880347:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636343.880446:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636343.880628:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963748736 00000100:00100000:1.0:1788636343.880688:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963748736 00000100:00100000:1.0:1788636343.880757:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 205 00000100:00100000:1.0:1788636343.880768:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963748736:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636343.880872:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+10:2362:x1875520963748736:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 105us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636343.880879:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 205 00000100:00100000:0.0:1788636343.882832:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963748864 00000100:00100000:0.0:1788636343.882848:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963748864 00000100:00100000:0.0:1788636343.883089:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:0.0:1788636343.883103:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963748864:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636343.883325:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963748864:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 224us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636343.883334:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00080000:3.0:1788636343.883379:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636343.936045:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976365824:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636343.936148:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636343.936301:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976365824 00000100:00100000:3.0:1788636343.936311:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976365824 00000100:00100000:3.0:1788636343.936388:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788636343.936399:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976365824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636343.936442:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636343.936498:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976365824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636343.936505:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1788636343.939711:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636343.939847:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c9500 x1875520976365824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636343.939881:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976365824:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788636344.257524:0:10099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 15:25:43 (1788636343) === 00000100:00100000:2.0:1788636344.732671:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636344.732866:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963748992 00000100:00100000:0.0:1788636344.732879:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963748992 00000100:00100000:0.0:1788636344.732941:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 206 00000100:00100000:0.0:1788636344.732952:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+10:8139:x1875520963748992:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636344.732974:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636344.732997:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd820fc200/0xa6aa59fb12fa7313 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155479 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636344.733034:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd820fc200/0xa6aa59fb12fa7313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155479 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636344.733048:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd820fc200/0xa6aa59fb12fa7313 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155479 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636344.733059:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd820fc200, rc 0) 00000100:00100000:0.0:1788636344.733142:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+11:8139:x1875520963748992:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 191us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636344.733149:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 206 00000100:00100000:1.0:1788636344.744048:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636344.744399:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963749120 00000100:00100000:2.0:1788636344.744412:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963749120 00000100:00100000:2.0:1788636344.744483:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 207 00000100:00100000:2.0:1788636344.744495:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+11:8139:x1875520963749120:12345-192.168.203.57@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788636344.744966:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+11:8139:x1875520963749120:12345-192.168.203.57@tcp:501:mount.lustre.0 Request processed in 472us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.744977:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 207 00000100:00100000:3.0:1788636344.751194:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636344.751725:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963749248 00000100:00100000:1.0:1788636344.751755:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963749248 00000100:00100000:0.0:1788636344.751936:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 208 00000100:00100000:0.0:1788636344.751951:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+11:8139:x1875520963749248:12345-192.168.203.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788636344.752218:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+11:8139:x1875520963749248:12345-192.168.203.57@tcp:503:mount.lustre.0 Request processed in 271us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636344.752227:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 208 00000100:00100000:1.0:1788636344.754390:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636344.754522:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963749376 00000100:00100000:2.0:1788636344.754533:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963749376 00000100:00100000:2.0:1788636344.754601:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 209 00000100:00100000:2.0:1788636344.754611:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+11:8143:x1875520963749376:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636344.754997:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+11:8143:x1875520963749376:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 385us (617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.755006:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 209 00000100:00100000:2.0:1788636344.765972:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636344.766189:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963749504 00000100:00100000:1.0:1788636344.766202:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963749504 00000100:00100000:1.0:1788636344.766271:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 210 00000100:00100000:1.0:1788636344.766282:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+11:8143:x1875520963749504:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636344.766687:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+11:8143:x1875520963749504:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 404us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636344.766696:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 210 00000100:00100000:3.0:1788636344.771530:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636344.771739:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963749632 00000100:00100000:2.0:1788636344.771753:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963749632 00000100:00100000:2.0:1788636344.771852:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 211 00000100:00100000:2.0:1788636344.771864:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+11:8139:x1875520963749632:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788636344.771885:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636344.771909:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa731a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351554a3 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636344.771945:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa731a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554a3 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636344.771958:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa731a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554a3 expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636344.771970:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ffc00, rc 0) 00000100:00100000:2.0:1788636344.772133:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:8139:x1875520963749632:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 270us (622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.772141:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 211 00000100:00100000:2.0:1788636344.776155:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636344.776286:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963749760 00000100:00100000:1.0:1788636344.776298:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963749760 00000100:00100000:1.0:1788636344.776468:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 212 00000100:00100000:1.0:1788636344.776485:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+12:8139:x1875520963749760:12345-192.168.203.57@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788636344.776525:0:5805:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788636344.776554:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788636344.776559:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788636344.776562:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788636344.776565:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788636344.781393:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+12:8139:x1875520963749760:12345-192.168.203.57@tcp:256:mount.lustre.0 Request processed in 4895us (5233us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636344.781413:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 212 00000100:00100000:0.0:1788636344.787919:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636344.788170:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963749888 00000100:00100000:2.0:1788636344.788183:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963749888 00000100:00100000:2.0:1788636344.788238:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 213 00000100:00100000:2.0:1788636344.788247:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:8139:x1875520963749888:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788636344.788265:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636344.788285:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351554aa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636344.788315:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636344.788325:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636344.788342:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe200, rc 0) 00000100:00100000:2.0:1788636344.788411:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:8139:x1875520963749888:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 165us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.788416:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 213 00000100:00100000:2.0:1788636344.790462:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636344.790544:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963750016 00000100:00100000:3.0:1788636344.790557:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963750016 00000100:00100000:3.0:1788636344.790631:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 214 00000100:00100000:3.0:1788636344.790643:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:8139:x1875520963750016:12345-192.168.203.57@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788636344.791132:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:8139:x1875520963750016:12345-192.168.203.57@tcp:501:mount.lustre.0 Request processed in 490us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.791139:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 214 00000100:00100000:1.0:1788636344.792884:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636344.793862:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963750144 00000100:00100000:0.0:1788636344.793874:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963750144 00000100:00100000:0.0:1788636344.793961:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 215 00000100:00100000:0.0:1788636344.793972:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:8139:x1875520963750144:12345-192.168.203.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788636344.794244:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:8139:x1875520963750144:12345-192.168.203.57@tcp:503:mount.lustre.0 Request processed in 273us (1366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636344.794254:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 215 00000100:00100000:0.0:1788636344.797186:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636344.797951:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963750272 00000100:00100000:2.0:1788636344.797981:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963750272 00000100:00100000:2.0:1788636344.798053:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 216 00000100:00100000:2.0:1788636344.798065:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:8148:x1875520963750272:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636344.798386:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:8148:x1875520963750272:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 322us (1212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.798395:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 216 00000100:00100000:1.0:1788636344.802651:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636344.802776:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963750400 00000100:00100000:2.0:1788636344.802790:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963750400 00000100:00100000:2.0:1788636344.802897:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 217 00000100:00100000:2.0:1788636344.802909:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:8148:x1875520963750400:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636344.803239:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:8148:x1875520963750400:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 332us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.803249:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 217 00000100:00100000:1.0:1788636344.806179:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636344.806300:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963750528 00000100:00100000:2.0:1788636344.806313:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963750528 00000100:00100000:2.0:1788636344.806541:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:2.0:1788636344.806551:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1875520963750528:12345-192.168.203.57@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788636344.806590:0:5810:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 05d1767c-40ac-4b63-986f-dfff0e865a57@192.168.203.57@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:2.0:1788636344.806651:0:5810:0:(genops.c:1385:class_connect()) connect: client 05d1767c-40ac-4b63-986f-dfff0e865a57, cookie 0xa6aa59fb12fa7328 00000004:00100000:2.0:1788636344.806691:0:5810:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788636344.807065:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9cfd818f2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636344.807167:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2359:x1875520963750528:12345-192.168.203.57@tcp:38:mount.lustre.0 Request processed in 614us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.807175:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:0.0:1788636344.815075:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636344.815265:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963750912 00000100:00100000:2.0:1788636344.815296:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963750912 00000100:00100000:2.0:1788636344.815437:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00100000:2.0:1788636344.815450:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963750912:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636344.815601:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963750912:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 153us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636344.815611:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00100000:3.0:1788636344.817306:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636344.817392:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636344.817603:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963750784 00000100:00100000:1.0:1788636344.817613:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963750784 00000100:00100000:1.0:1788636344.817744:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963750656 00000100:00100000:1.0:1788636344.817748:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963750656 00000100:00100000:1.0:1788636344.817774:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:1.0:1788636344.817784:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+7:8139:x1875520963750784:12345-192.168.203.57@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788636344.817926:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:3.0:1788636344.817937:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+7:0:x1875520963750656:12345-192.168.203.57@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788636344.818063:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788636344.818190:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+7:8139:x1875520963750784:12345-192.168.203.57@tcp:41:mount.lustre.0 Request processed in 407us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636344.818197:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00000004:00000024:3.0:1788636344.818331:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788636344.818374:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+6:0:x1875520963750656:12345-192.168.203.57@tcp:41:mount.lustre.0 Request processed in 430us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636344.818382:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00080000:0.0:1788636344.818561:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636344.822468:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636344.822602:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963751040 00000100:00100000:3.0:1788636344.822614:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963751040 00000100:00100000:3.0:1788636344.822733:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:3.0:1788636344.822746:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+6:8139:x1875520963751040:12345-192.168.203.57@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788636344.822914:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+6:8139:x1875520963751040:12345-192.168.203.57@tcp:40:mount.lustre.0 Request processed in 171us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636344.822923:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:0.0:1788636344.827785:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636344.827885:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636344.827920:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636344.828085:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963751168 00000100:00100000:1.0:1788636344.828097:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963751168 00000100:00100000:1.0:1788636344.828150:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963751296 00000100:00100000:1.0:1788636344.828154:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963751296 00000100:00100000:1.0:1788636344.828177:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:1.0:1788636344.828187:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2359:x1875520963751168:12345-192.168.203.57@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788636344.828228:0:6662:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 05d1767c-40ac-4b63-986f-dfff0e865a57@192.168.203.57@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:1.0:1788636344.828272:0:6662:0:(genops.c:1385:class_connect()) connect: client 05d1767c-40ac-4b63-986f-dfff0e865a57, cookie 0xa6aa59fb12fa732f 00002000:00100000:1.0:1788636344.828287:0:6662:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 05d1767c-40ac-4b63-986f-dfff0e865a57/ffff9cfd6132c000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788636344.828301:0:6662:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788636344.828400:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:0.0:1788636344.828407:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1875520963751296:12345-192.168.203.57@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788636344.828425:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 05d1767c-40ac-4b63-986f-dfff0e865a57@192.168.203.57@tcp t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1788636344.828445:0:6659:0:(genops.c:1385:class_connect()) connect: client 05d1767c-40ac-4b63-986f-dfff0e865a57, cookie 0xa6aa59fb12fa7336 00002000:00100000:0.0:1788636344.828450:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 05d1767c-40ac-4b63-986f-dfff0e865a57/ffff9cfd75dc3000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788636344.828477:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788636344.828773:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788636344.828838:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9cfd75dc5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636344.829060:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963751424 00000100:00100000:3.0:1788636344.829066:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963751424 00000100:00100000:3.0:1788636344.829112:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:3.0:1788636344.829120:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+6:8139:x1875520963751424:12345-192.168.203.57@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788636344.829205:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788636344.829299:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+6:8139:x1875520963751424:12345-192.168.203.57@tcp:33:mount.lustre.0 Request processed in 180us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636344.829306:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:0.0:1788636344.829405:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2359:x1875520963751296:12345-192.168.203.57@tcp:8:mount.lustre.0 Request processed in 997us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636344.829413:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00002000:00080000:1.0:1788636344.829687:0:6662:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788636344.829711:0:6662:0:(import.c:65:import_set_state_nolock()) ffff9cfd6132f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636344.829740:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2359:x1875520963751168:12345-192.168.203.57@tcp:8:mount.lustre.0 Request processed in 1554us (1971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636344.829746:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 12 00010000:00010000:0.0:1788636344.895019:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788636345.039140:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 05d1767c-40ac-4b63-986f-dfff0e865a57 00010000:00010000:1.0:1788636345.921579:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636346.943207:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636347.008293:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976366208:0@lo:400:kworker.0 00000100:00100000:1.0:1788636347.008405:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636347.008449:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976366208 00000100:00100000:3.0:1788636347.008460:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976366208 00000100:00100000:1.0:1788636347.008493:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788636347.008513:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976366080:0@lo:400:kworker.0 00000100:00100000:1.0:1788636347.008540:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636347.008598:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976365952:0@lo:400:kworker.0 00000100:00100000:1.0:1788636347.008643:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976366592:0@lo:400:kworker.0 00000100:00100000:0.0:1788636347.012353:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636347.012421:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976366464:0@lo:400:kworker.0 00000100:00100000:0.0:1788636347.012463:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636347.012532:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976366080 00000100:00100000:3.0:1788636347.012544:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976366080 00000100:00100000:3.0:1788636347.012617:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788636347.012628:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976366208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636347.012698:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976366208:12345-0@lo:400:kworker.0 Request processed in 72us (4293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636347.012705:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788636347.012727:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788636347.013332:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976366080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636347.013382:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976366080:12345-0@lo:400:kworker.0 Request processed in 648us (4841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636347.013389:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1788636347.013831:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636347.014925:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976366336:0@lo:400:kworker.0 00000100:00100000:3.0:1788636347.014997:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636347.015073:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976366336 00000100:00100000:3.0:1788636347.015083:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976366336 00000100:00100000:3.0:1788636347.015152:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788636347.015163:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976366336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636347.016162:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976366336:12345-0@lo:400:kworker.0 Request processed in 994us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636347.016173:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788636347.016836:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636347.016875:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788636347.016888:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6a334380 x1875520976366336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636347.016907:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976366336:0@lo:400:kworker.0 00000100:00100000:1.0:1788636347.016926:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976366208:0@lo:400:kworker.0 00000100:00100000:1.0:1788636347.016953:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a334a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976366080:0@lo:400:kworker.0 00000100:00100000:0.0:1788636347.017159:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976365952 00000100:00100000:0.0:1788636347.017168:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976365952 00000100:00100000:0.0:1788636347.017213:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788636347.017222:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976365952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636347.017271:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976365952:12345-0@lo:400:kworker.0 Request processed in 50us (4928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636347.017278:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788636347.017312:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976366464 00000100:00100000:0.0:1788636347.017315:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976366464 00000100:00100000:0.0:1788636347.017347:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788636347.017353:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976366464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636347.017387:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976366464:12345-0@lo:400:kworker.0 Request processed in 34us (4923us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636347.017394:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:0.0:1788636347.017410:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636347.017426:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976365952:0@lo:400:kworker.0 00000100:00100000:0.0:1788636347.017438:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976366464:0@lo:400:kworker.0 00000100:00100000:3.0:1788636347.020614:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976366592 00000100:00100000:3.0:1788636347.020635:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976366592 00000100:00100000:3.0:1788636347.021649:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788636347.021664:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976366592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636347.021943:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976366592:12345-0@lo:400:kworker.0 Request processed in 282us (5068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636347.021952:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1788636347.022017:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6a337100 x1875520976366592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636347.022199:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976366592:0@lo:400:kworker.0 00000100:00080000:2.0:1788636347.022709:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636347.519177:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636347.519208:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976366720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636347.519296:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636347.519441:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976366720 00000100:00100000:2.0:1788636347.519451:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976366720 00000100:00100000:2.0:1788636347.519518:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636347.519529:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976366720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636347.519570:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636347.519632:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976366720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636347.519639:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788636347.519681:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7eef9c00 x1875520976366720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636347.519701:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976366720:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788636347.971856:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788636348.102957:0:5832:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 05d1767c-40ac-4b63-986f-dfff0e865a57 00000001:00100000:0.0:1788636348.128480:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 05d1767c-40ac-4b63-986f-dfff0e865a57 00010000:00010000:0.0:1788636348.991007:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636349.055317:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636349.055348:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976366848:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636349.055442:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636349.058545:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976366848 00000100:00100000:2.0:1788636349.058568:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976366848 00000100:00080000:0.0:1788636349.058818:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636349.058943:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636349.058956:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976366848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636349.059008:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636349.059140:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976366848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 188us (3698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636349.059169:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788636349.059295:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612ca300 x1875520976366848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636365 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636349.059325:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976366848:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788636350.015202:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636350.039119:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636350.039158:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636350.039218:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636350.039240:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636350.039285:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963751552 00000100:00100000:2.0:1788636350.039296:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963751552 00000100:00100000:1.0:1788636350.039316:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636350.039353:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 219 00000100:00100000:3.0:1788636350.039364:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963751808 00000100:00100000:2.0:1788636350.039364:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963751552:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636350.039371:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963751808 00000100:00100000:3.0:1788636350.039419:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963751680 00000100:00100000:3.0:1788636350.039423:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963751680 00000100:00100000:2.0:1788636350.039452:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963751552:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 91us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636350.039471:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 219 00000100:00100000:3.0:1788636350.039570:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:3.0:1788636350.039578:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963751808:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636350.039620:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963752064 00000100:00100000:2.0:1788636350.039625:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963752064 00000100:00100000:2.0:1788636350.039664:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963751936 00000100:00100000:2.0:1788636350.039667:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963751936 00000100:00100000:2.0:1788636350.039688:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:2.0:1788636350.039694:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963752064:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636350.039723:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963752064:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 28us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636350.039725:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963751808:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 146us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636350.039738:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:3.0:1788636350.039740:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:2.0:1788636350.039757:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:3.0:1788636350.039763:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00100000:2.0:1788636350.039768:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963751936:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636350.039776:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963751680:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636350.039815:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963751936:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636350.039823:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:3.0:1788636350.039838:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963751680:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 65us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636350.039847:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00080000:2.0:1788636350.039860:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636350.039866:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636350.039877:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1788636350.776444:0:10296:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788636351.040013:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636352.069031:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636352.132499:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976367360:0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.132597:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636352.132664:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788636352.132671:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976366976:0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.132705:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636352.132731:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976367488:0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.132758:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636352.132787:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976367104:0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.132833:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636352.132853:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976367616:0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.132876:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636352.132894:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636352.132899:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976367232:0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.132921:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636352.132959:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976367360 00000100:00100000:2.0:1788636352.132968:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976367360 00000100:00100000:2.0:1788636352.133028:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976367616 00000100:00100000:2.0:1788636352.133031:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976367616 00000100:00100000:2.0:1788636352.133058:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636352.133068:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976367360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.133128:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976367360:12345-0@lo:400:kworker.0 Request processed in 60us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636352.133136:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636352.133154:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788636352.133177:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976367616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.135225:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976367616:12345-0@lo:400:kworker.0 Request processed in 2056us (2340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636352.135239:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788636352.135282:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976366976 00000100:00100000:2.0:1788636352.135291:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976366976 00000100:00100000:2.0:1788636352.135337:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788636352.135346:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976366976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.135387:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976366976:12345-0@lo:400:kworker.0 Request processed in 42us (2681us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636352.135394:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788636352.135430:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976367488 00000100:00100000:2.0:1788636352.135435:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976367488 00000100:00100000:2.0:1788636352.135479:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976367104 00000100:00100000:2.0:1788636352.135483:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976367104 00000100:00100000:2.0:1788636352.135496:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976367232 00000100:00100000:2.0:1788636352.135499:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976367232 00000100:00100000:2.0:1788636352.135515:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788636352.135520:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976367488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.135554:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976367488:12345-0@lo:400:kworker.0 Request processed in 34us (2796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636352.135560:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788636352.135571:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788636352.135576:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976367104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.135611:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976367104:12345-0@lo:400:kworker.0 Request processed in 36us (2778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636352.135617:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788636352.135627:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788636352.135649:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976367232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.135677:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976367232:12345-0@lo:400:kworker.0 Request processed in 30us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636352.135683:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788636352.135715:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636352.135720:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636352.135723:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636352.135774:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976366976:0@lo:400:kworker.0 00000100:00100000:2.0:1788636352.135820:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976367488:0@lo:400:kworker.0 00010000:00080000:2.0:1788636352.135842:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7eefb100 x1875520976367360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636352.135854:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eefb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976367360:0@lo:400:kworker.0 00010000:00080000:3.0:1788636352.142406:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7eef9180 x1875520976367616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636352.142431:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eef9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976367616:0@lo:400:kworker.0 00000100:00100000:3.0:1788636352.142486:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976367232:0@lo:400:kworker.0 00000100:00100000:3.0:1788636352.142500:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976367104:0@lo:400:kworker.0 00000100:00100000:3.0:1788636352.641907:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636352.641939:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976367744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636352.642026:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636352.642106:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976367744 00000100:00100000:3.0:1788636352.642116:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976367744 00000100:00100000:3.0:1788636352.642175:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788636352.642185:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976367744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636352.642232:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636352.642288:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976367744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636352.642296:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788636352.642362:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612cad80 x1875520976367744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636352.642383:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976367744:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636353.086947:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636354.111018:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636354.175037:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976367872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636354.175111:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636354.175227:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976367872 00000100:00100000:3.0:1788636354.175235:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976367872 00000100:00100000:3.0:1788636354.175303:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788636354.175313:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976367872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636354.175370:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636354.175427:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976367872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636354.175434:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1788636354.175603:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636354.175631:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612cad80 x1875520976367872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636354.175650:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976367872:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788636355.135020:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636355.147425:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636355.147479:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636355.147508:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636355.147529:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636355.147558:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636355.147597:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963752448 00000100:00100000:2.0:1788636355.147615:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963752448 00000100:00100000:2.0:1788636355.147677:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963752320 00000100:00100000:2.0:1788636355.147680:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963752320 00000100:00100000:2.0:1788636355.147714:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 68 00000100:00100000:2.0:1788636355.147724:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963752448:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636355.147836:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963752448:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636355.147844:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 68 00000100:00100000:2.0:1788636355.147861:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:2.0:1788636355.147868:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963752320:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636355.147896:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963752320:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 28us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636355.147902:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:2.0:1788636355.147921:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963752704 00000100:00100000:2.0:1788636355.147924:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963752704 00000100:00100000:2.0:1788636355.147950:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963752576 00000100:00100000:2.0:1788636355.147953:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963752576 00000100:00100000:2.0:1788636355.147972:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 41 00000100:00100000:2.0:1788636355.147978:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963752704:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636355.148005:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963752704:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 27us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636355.148011:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 41 00000100:00100000:2.0:1788636355.148023:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:2.0:1788636355.148029:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f33a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963752576:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636355.148052:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f33a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963752576:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 23us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636355.148065:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00080000:2.0:1788636355.148235:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636355.148240:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636355.148242:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636355.148680:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963752192 00000100:00100000:3.0:1788636355.148685:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963752192 00000100:00100000:3.0:1788636355.148724:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 221 00000100:00100000:3.0:1788636355.148732:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963752192:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636355.148776:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963752192:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 44us (1360us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636355.148783:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 221 00010000:00010000:2.0:1788636356.159076:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636357.185685:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636357.247405:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976368000:0@lo:400:kworker.0 00000100:00100000:1.0:1788636357.247405:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976368128:0@lo:400:kworker.0 00000100:00100000:3.0:1788636357.248450:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976368384:0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.250860:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636357.250861:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636357.250922:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976368512:0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.250957:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636357.250990:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976368256:0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.251015:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636357.251046:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976368128 00000100:00100000:2.0:1788636357.251053:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976368128 00000100:00100000:2.0:1788636357.251092:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976368512 00000100:00100000:2.0:1788636357.251095:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976368512 00000100:00100000:2.0:1788636357.251116:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976368256 00000100:00100000:2.0:1788636357.251119:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976368256 00000100:00100000:2.0:1788636357.251133:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788636357.251141:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976368128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.251188:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976368128:12345-0@lo:400:kworker.0 Request processed in 48us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636357.251195:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788636357.251209:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788636357.251215:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976368512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.251244:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976368512:12345-0@lo:400:kworker.0 Request processed in 30us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636357.251323:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788636357.251336:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788636357.251342:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976368256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.251375:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976368256:12345-0@lo:400:kworker.0 Request processed in 34us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636357.251380:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788636357.251404:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636357.251448:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976368256:0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.251475:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976368512:0@lo:400:kworker.0 00000100:00100000:1.0:1788636357.251634:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976368128:0@lo:400:kworker.0 00000100:00100000:1.0:1788636357.251642:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976368640:0@lo:400:kworker.0 00000100:00100000:1.0:1788636357.251672:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636357.251748:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976368640 00000100:00100000:2.0:1788636357.251751:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976368640 00000100:00100000:2.0:1788636357.251788:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788636357.251804:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976368640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.251830:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976368640:12345-0@lo:400:kworker.0 Request processed in 38us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636357.251834:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788636357.252040:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636357.252635:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788636357.252665:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75bd7800 x1875520976368640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636357.252678:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976368640:0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.253409:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976368384 00000100:00100000:2.0:1788636357.253418:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976368384 00000100:00100000:2.0:1788636357.253489:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788636357.253498:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976368384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636357.253792:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976368384:12345-0@lo:400:kworker.0 Request processed in 294us (1751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636357.253820:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788636357.253890:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636357.254658:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976368000 00000100:00100000:0.0:1788636357.254667:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976368000 00000100:00100000:0.0:1788636357.254717:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:0.0:1788636357.254726:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976368000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636357.254815:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976368000:12345-0@lo:400:kworker.0 Request processed in 71us (3941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636357.254821:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788636357.255332:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976368000:0@lo:400:kworker.0 00010000:00080000:0.0:1788636357.255879:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75bd5880 x1875520976368384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636357.255893:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976368384:0@lo:400:kworker.0 00000100:00100000:3.0:1788636357.758973:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976368768:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636357.759042:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636357.759131:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976368768 00000100:00100000:3.0:1788636357.759139:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976368768 00000100:00100000:3.0:1788636357.759184:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788636357.759192:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976368768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636357.759228:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636357.759286:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976368768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636357.759293:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788636357.759336:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c9180 x1875520976368768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636357.759367:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976368768:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636358.209037:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636359.230941:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636359.295574:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976368896:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636359.295718:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636359.295783:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976368896 00000100:00100000:1.0:1788636359.295792:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976368896 00000100:00080000:2.0:1788636359.295880:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636359.295886:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788636359.295897:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976368896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636359.295932:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636359.295986:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976368896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636359.295993:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788636359.296060:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7eefa300 x1875520976368896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636375 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636359.296082:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976368896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788636360.254899:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636360.266179:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636360.266228:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636360.266264:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636360.266287:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636360.266308:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636360.266340:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963752832 00000100:00100000:0.0:1788636360.266340:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963753344 00000100:00100000:0.0:1788636360.266350:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963753344 00000100:00100000:2.0:1788636360.266358:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963752832 00000100:00100000:2.0:1788636360.266429:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 223 00000100:00100000:0.0:1788636360.266429:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963753216 00000100:00100000:0.0:1788636360.266435:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963753216 00000100:00100000:2.0:1788636360.266443:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963752832:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636360.266464:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:0.0:1788636360.266475:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963753344:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636360.266515:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963752832:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 75us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636360.266516:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963753344:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 42us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636360.266531:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:2.0:1788636360.266536:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 223 00000100:00100000:0.0:1788636360.266560:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:0.0:1788636360.266568:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963753216:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636360.267169:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963753088 00000100:00100000:3.0:1788636360.267176:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963753088 00000100:00100000:3.0:1788636360.267219:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963752960 00000100:00100000:3.0:1788636360.267223:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963752960 00000100:00100000:3.0:1788636360.267248:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 73 00000100:00100000:3.0:1788636360.267256:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963753088:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636360.271739:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 74 00000100:00100000:2.0:1788636360.271757:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963752960:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636360.271853:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963752960:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 103us (5564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636360.271862:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 74 00000100:00080000:0.0:1788636360.271908:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636360.271915:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636360.271918:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636360.271955:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963753216:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 5386us (5644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636360.271964:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:3.0:1788636360.272443:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963753088:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 5185us (6210us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636360.272451:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 73 00010000:00010000:0.0:1788636361.279112:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636362.305389:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636362.368110:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976369152:0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.369041:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976369408:0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.369247:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636362.369309:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788636362.369317:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976369024:0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.369348:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636362.369376:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976369536:0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.369418:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636362.369513:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976369280:0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.369531:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976369408 00000100:00100000:0.0:1788636362.369541:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976369408 00000100:00100000:3.0:1788636362.369560:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636362.369613:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788636362.369623:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976369408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636362.369649:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976369536 00000100:00100000:3.0:1788636362.369654:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976369536 00000100:00100000:3.0:1788636362.369688:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976369280 00000100:00100000:3.0:1788636362.369691:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976369280 00000100:00100000:3.0:1788636362.369720:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788636362.369728:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976369536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636362.369777:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976369536:12345-0@lo:400:kworker.0 Request processed in 49us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636362.369785:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788636362.369793:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976369408:12345-0@lo:400:kworker.0 Request processed in 171us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636362.369824:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636362.369828:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788636362.369836:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976369280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.369847:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976369024 00000100:00100000:0.0:1788636362.369852:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976369024 00000100:00100000:0.0:1788636362.369882:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788636362.369887:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976369280:12345-0@lo:400:kworker.0 Request processed in 39us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636362.369892:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976369024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636362.369907:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788636362.369928:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976369024:12345-0@lo:400:kworker.0 Request processed in 38us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636362.369936:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00080000:0.0:1788636362.369971:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636362.369977:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636362.370009:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976369024:0@lo:400:kworker.0 00000100:00100000:3.0:1788636362.370014:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976369280:0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.370028:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976369536:0@lo:400:kworker.0 00010000:00080000:0.0:1788636362.370045:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75bd4380 x1875520976369408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636362.370057:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976369408:0@lo:400:kworker.0 00000100:00100000:1.0:1788636362.371364:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636362.371402:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976369664:0@lo:400:kworker.0 00000100:00100000:1.0:1788636362.371434:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636362.371500:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976369664 00000100:00100000:0.0:1788636362.371507:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976369664 00000100:00100000:0.0:1788636362.371550:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788636362.371558:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976369664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.371608:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976369664:12345-0@lo:400:kworker.0 Request processed in 51us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636362.371626:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1788636362.371631:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75bd5880 x1875520976369664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636362.371644:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976369664:0@lo:400:kworker.0 00000100:00080000:0.0:1788636362.371752:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636362.372449:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976369152 00000100:00100000:3.0:1788636362.372456:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976369152 00000100:00100000:3.0:1788636362.372488:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636362.372496:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976369152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636362.372542:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976369152:12345-0@lo:400:kworker.0 Request processed in 47us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636362.372548:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636362.372582:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976369152:0@lo:400:kworker.0 00000100:00100000:0.0:1788636362.879111:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976369792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636362.879206:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636362.879372:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976369792 00000100:00100000:2.0:1788636362.879381:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976369792 00000100:00100000:2.0:1788636362.879441:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636362.879451:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976369792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636362.879490:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636362.879546:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976369792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636362.879554:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1788636362.880160:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c8e00 x1875520976369792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636362.880179:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976369792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788636363.330305:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636364.350984:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636364.415085:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976369920:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636364.415142:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636364.415210:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976369920 00000100:00100000:2.0:1788636364.415217:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976369920 00000100:00100000:2.0:1788636364.415325:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788636364.415335:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976369920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636364.415376:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636364.415441:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976369920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636364.415448:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1788636364.415470:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636364.415510:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7eef9c00 x1875520976369920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636380 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636364.415528:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eef9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976369920:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1788636364.756162:0:10996:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788636365.376139:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636365.407158:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636365.407276:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636365.412114:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963753600 00000100:00100000:1.0:1788636365.412129:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963753600 00000100:00100000:0.0:1788636365.412282:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 78 00000100:00100000:0.0:1788636365.412294:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963753600:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636365.412382:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963753600:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 80us (5222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636365.412390:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 78 00000100:00080000:3.0:1788636365.412547:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636365.415465:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636365.415514:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636365.415631:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636365.415663:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963753728 00000100:00100000:2.0:1788636365.415671:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963753728 00000100:00100000:0.0:1788636365.416390:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963753856 00000100:00100000:0.0:1788636365.416397:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963753856 00000100:00100000:0.0:1788636365.416442:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963753984 00000100:00100000:0.0:1788636365.416446:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963753984 00000100:00100000:0.0:1788636365.416470:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:0.0:1788636365.416488:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2359:x1875520963753856:12345-192.168.203.57@tcp:9:kworker.0 00000020:00000080:0.0:1788636365.416518:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa732f 00000100:00080000:0.0:1788636365.416527:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9cfd6132f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788636365.416565:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788636365.416961:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+2:2359:x1875520963753856:12345-192.168.203.57@tcp:9:kworker.0 Request processed in 481us (9693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636365.416970:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:0.0:1788636365.417002:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:0.0:1788636365.417009:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2359:x1875520963753984:12345-192.168.203.57@tcp:9:kworker.0 00000020:00000080:0.0:1788636365.417022:0:6659:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7336 00000100:00080000:0.0:1788636365.417029:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9cfd75dc5800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788636365.417054:0:6659:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788636365.417247:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+2:2359:x1875520963753984:12345-192.168.203.57@tcp:9:kworker.0 Request processed in 237us (1790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636365.417253:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 15 00010000:00010000:0.0:1788636365.417482:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636365.417620:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 79 00000100:00100000:2.0:1788636365.417632:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963753728:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636365.417665:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963753728:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 37us (2034us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636365.417671:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 79 00000100:00080000:2.0:1788636365.417690:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636365.417694:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636365.417697:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636365.417706:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636365.420737:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963753472 00000100:00100000:1.0:1788636365.420751:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963753472 00000100:00100000:1.0:1788636365.420819:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 225 00000100:00100000:1.0:1788636365.420830:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963753472:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636365.420910:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963753472:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 82us (5394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636365.420930:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 225 00000001:00100000:2.0:1788636365.482715:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 05d1767c-40ac-4b63-986f-dfff0e865a57 00000020:00000080:2.0:1788636365.482729:0:6685:0:(genops.c:885:class_export_put()) final put ffff9cfd6132c000/05d1767c-40ac-4b63-986f-dfff0e865a57 00000020:00000080:1.0:1788636365.482821:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd6132c000/05d1767c-40ac-4b63-986f-dfff0e865a57 for lustre-OST0000 00000020:00000080:1.0:1788636365.482860:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd6132f800 for lustre-OST0000 00010000:00010000:0.0:1788636366.398942:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636367.423132:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636367.487148:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636367.487303:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976370176:0@lo:400:kworker.0 00000100:00100000:1.0:1788636367.487380:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636367.487500:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636367.487507:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976370304:0@lo:400:kworker.0 00000100:00100000:1.0:1788636367.487531:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636367.487567:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976370176 00000100:00100000:1.0:1788636367.487574:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976370176 00000100:00100000:1.0:1788636367.487613:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976370304 00000100:00100000:1.0:1788636367.487617:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976370304 00000100:00100000:1.0:1788636367.487644:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788636367.487651:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976370176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636367.487708:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976370176:12345-0@lo:400:kworker.0 Request processed in 57us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636367.487714:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788636367.487728:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788636367.487734:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976370304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636367.487758:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976370304:12345-0@lo:400:kworker.0 Request processed in 25us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636367.487763:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:1.0:1788636367.487780:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636367.487829:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976370304:0@lo:400:kworker.0 00000100:00100000:1.0:1788636367.487840:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976370176:0@lo:400:kworker.0 00000100:00100000:2.0:1788636367.492385:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976370432:0@lo:400:kworker.0 00000100:00100000:2.0:1788636367.492473:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636367.492533:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976370048:0@lo:400:kworker.0 00000100:00100000:2.0:1788636367.492562:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636367.492777:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976370048 00000100:00100000:3.0:1788636367.492785:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976370048 00000100:00100000:3.0:1788636367.492852:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788636367.492861:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976370048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636367.492914:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976370048:12345-0@lo:400:kworker.0 Request processed in 54us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636367.492921:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788636367.493723:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976370048:0@lo:400:kworker.0 00000100:00100000:3.0:1788636367.493918:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976370560:0@lo:400:kworker.0 00000100:00100000:3.0:1788636367.493965:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636367.494009:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636367.494017:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976370688:0@lo:400:kworker.0 00000100:00100000:3.0:1788636367.494041:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636367.494154:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976370432 00000100:00100000:0.0:1788636367.494160:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976370432 00000100:00100000:0.0:1788636367.494207:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976370688 00000100:00100000:0.0:1788636367.494210:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976370688 00000100:00100000:0.0:1788636367.494228:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636367.494235:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976370432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636367.494274:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976370432:12345-0@lo:400:kworker.0 Request processed in 39us (1809us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636367.494280:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636367.494293:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788636367.494298:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976370688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636367.494327:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976370688:12345-0@lo:400:kworker.0 Request processed in 29us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636367.494333:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788636367.494372:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b71f80 x1875520976370688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636367.494383:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976370688:0@lo:400:kworker.0 00000100:00100000:0.0:1788636367.494416:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976370560 00000100:00100000:0.0:1788636367.494419:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976370560 00000100:00100000:0.0:1788636367.494447:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788636367.494453:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976370560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636367.494554:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976370560:12345-0@lo:400:kworker.0 Request processed in 100us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636367.494560:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788636367.494586:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976370560:0@lo:400:kworker.0 00000100:00080000:3.0:1788636367.494636:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636367.494640:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636367.494647:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636367.496138:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b72680 x1875520976370432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636383 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636367.496151:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976370432:0@lo:400:kworker.0 00000100:00100000:1.0:1788636367.999614:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976370816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636367.999680:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636367.999781:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976370816 00000100:00100000:3.0:1788636367.999789:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976370816 00000100:00100000:3.0:1788636367.999856:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788636367.999866:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976370816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636367.999897:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636367.999974:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976370816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636367.999981:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788636368.000465:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd612c8e00 x1875520976370816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636368.000483:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976370816:0@lo:13:osp-pre-1-0.0 00000020:00000080:1.0:1788636368.108394:0:11145:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2d98cb20 20000000:00000080:1.0:1788636368.108409:0:11145:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cfd7fe6e400 uarg=0000000000000000 20000000:01000000:1.0:1788636368.108441:0:11145:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788636368.108446:0:11145:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788636368.108450:0:11145:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788636368.109216:0:11146:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1788636368.109350:0:11145:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788636368.113603:0:11145:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1788636368.113630:0:11145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113650:0:11145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113660:0:11145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113666:0:11145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113673:0:11145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113680:0:11145:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113686:0:11145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113742:0:11145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113756:0:11145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 12 pid: 5803 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636368.113771:0:11145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976370944:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636368.113896:0:11145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113906:0:11145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 18 pid: 5804 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636368.113915:0:11145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976371072:0@lo:104: 00000100:00100000:1.0:1788636368.113950:0:11145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636368.113978:0:11145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.113986:0:11145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 18 pid: 5805 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636368.113994:0:11145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976371200:0@lo:104: 00000100:00100000:1.0:1788636368.114010:0:11145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636368.114026:0:11145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.114034:0:11145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 18 pid: 5803 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636368.114052:0:11145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976371328:0@lo:104: 00000100:00100000:1.0:1788636368.114082:0:11145:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636368.114099:0:11145:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.114107:0:11145:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 12 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636368.114116:0:11145:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81965180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976371456:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636368.114136:0:11145:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd75932900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636368.115287:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976371072 00000100:00100000:0.0:1788636368.115296:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976371072 00000100:00100000:0.0:1788636368.115331:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976371200 00000100:00100000:0.0:1788636368.115333:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976371200 00000100:00100000:0.0:1788636368.115341:0:5793:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976371328 00000100:00100000:0.0:1788636368.115344:0:5793:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976371328 00000100:00100000:0.0:1788636368.115368:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636368.115377:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+5:11145:x1875520976371072:12345-0@lo:104: 00010000:00010000:0.0:1788636368.115391:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.115528:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788636368.115535:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+5:11145:x1875520976371072:12345-0@lo:104: Request processed in 160us (1584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636368.115542:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636368.115558:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636368.115564:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+4:11145:x1875520976371200:12345-0@lo:104: 00010000:00010000:0.0:1788636368.115572:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.115617:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788636368.115622:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+4:11145:x1875520976371200:12345-0@lo:104: Request processed in 58us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636368.115628:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636368.115639:0:5793:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788636368.115644:0:5793:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:11145:x1875520976371328:12345-0@lo:104: 00010000:00010000:0.0:1788636368.115651:0:5793:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.115673:0:5793:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788636368.115677:0:5793:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:1196c107-eaca-4490-96fc-d60d67da8edc+3:11145:x1875520976371328:12345-0@lo:104: Request processed in 34us (1596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636368.115682:0:5793:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788636368.117543:0:11145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd7800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976371072:0@lo:104: 00000100:00100000:1.0:1788636368.117558:0:11145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976371200:0@lo:104: 00000100:00100000:1.0:1788636368.117566:0:11145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976371328:0@lo:104: 00010000:00010000:0.0:1788636368.117679:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636368.117687:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.117696:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffa00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636368.117701:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.117711:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636368.117719:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636368.117727:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636368.117832:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.117840:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636368.117870:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.117877:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa7305 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa730c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.117893:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636368.117896:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.117902:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636368.117905:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.117912:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636368.117919:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636368.117924:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1788636368.117981:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976371584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636368.118035:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636368.118091:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976371584 00000100:00100000:2.0:1788636368.118097:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976371584 00010000:00010000:2.0:1788636368.118122:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 19 pid: 5804 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636368.118156:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636368.118164:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976371584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636368.118176:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636368.118181:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 19 pid: 5804 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636368.118197:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 19 pid: 5804 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636368.118212:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521ffe00/0xa6aa59fb12fa730c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7305 expref: 19 pid: 5804 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636368.118224:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636368.118255:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699aa050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+18:3280:x1875520976371584:12345-0@lo:103:ldlm_bl.0 Request processed in 93us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636368.118262:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636368.118315:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976371584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636368.120100:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636368.120168:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636368.120452:0:11145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976370944:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636368.120475:0:11145:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81965180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11145:1875520976371456:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636368.120509:0:11145:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636368.121100:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636368.121439:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636368.121442:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636368.121444:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636368.121531:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.121542:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fec00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:3.0:1788636368.121546:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.121557:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636368.121565:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636368.121572:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788636368.121625:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.121632:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636368.121656:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.121664:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521fec00/0xa6aa59fb12fa72e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa72f0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.121677:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636368.121678:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636368.121680:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636368.121687:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636368.121700:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976371712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636368.121761:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636368.121831:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963754240 00000100:00100000:3.0:1788636368.121837:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963754240 00010000:00010000:3.0:1788636368.121863:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 13 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636368.121886:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963754112 00000100:00100000:3.0:1788636368.121890:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963754112 00010000:00010000:3.0:1788636368.121900:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 14 pid: 5803 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636368.121910:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976371712 00000100:00100000:3.0:1788636368.121912:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976371712 00010000:00010000:3.0:1788636368.121923:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 18 pid: 5803 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636368.121936:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:3.0:1788636368.121951:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:003dba47-3849-46de-b5b5-7b33358ec353+14:2363:x1875520963754240:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636368.121963:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636368.121968:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 14 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.121979:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 14 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.121993:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167d600/0xa6aa59fb12fa72e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155472 expref: 14 pid: 5804 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.122005:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636368.122044:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963754240:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 94us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636368.122052:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:3.0:1788636368.122067:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:3.0:1788636368.122073:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:003dba47-3849-46de-b5b5-7b33358ec353+12:2362:x1875520963754112:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636368.122080:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636368.122085:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 12 pid: 5803 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.122095:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 12 pid: 5803 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.122104:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fe200/0xa6aa59fb12fa7321 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554aa expref: 12 pid: 5803 timeout: 337 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.122113:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636368.122135:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:003dba47-3849-46de-b5b5-7b33358ec353+11:2362:x1875520963754112:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 62us (1967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636368.122142:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:3.0:1788636368.122154:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636368.122160:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+18:3280:x1875520976371712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636368.122167:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636368.122172:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 18 pid: 5803 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.122180:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 18 pid: 5803 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.122190:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa72f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa72e9 expref: 18 pid: 5803 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.122199:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636368.122562:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+17:3280:x1875520976371712:12345-0@lo:103:ldlm_bl.0 Request processed in 400us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636368.122569:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:0.0:1788636368.122653:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.122661:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636368.122688:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.122707:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997de00/0xa6aa59fb12fa72f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa72fe expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636368.122723:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636368.122725:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636368.122737:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636368.123137:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976371840:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636368.123172:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636368.124278:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976371712:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636368.124393:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976371840 00000100:00100000:3.0:1788636368.124399:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976371840 00010000:00010000:3.0:1788636368.124427:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 17 pid: 5805 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636368.124553:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788636368.124563:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+17:3282:x1875520976371840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636368.124587:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636368.124591:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 17 pid: 5805 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124601:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 17 pid: 5805 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124613:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fe800/0xa6aa59fb12fa72fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa72f7 expref: 17 pid: 5805 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124627:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124635:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124649:0:5795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124656:0:5795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124663:0:5795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124669:0:5795:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124675:0:5795:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167c800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636368.124679:0:5795:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124698:0:5795:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124719:0:5795:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636368.124737:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636368.124819:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+16:3282:x1875520976371840:12345-0@lo:103:ldlm_bl.0 Request processed in 258us (1646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636368.124827:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:1.0:1788636368.124885:0:11145:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.124894:0:11145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636368.124900:0:11145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167c800/0xa6aa59fb12fa733d lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636368.125439:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976371840:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636368.447152:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788636368.597033:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 05d1767c-40ac-4b63-986f-dfff0e865a57 00000020:00000080:3.0:1788636368.597042:0:7625:0:(genops.c:885:class_export_put()) final put ffff9cfd75dc3000/05d1767c-40ac-4b63-986f-dfff0e865a57 00000020:00000080:1.0:1788636368.597098:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd75dc3000/05d1767c-40ac-4b63-986f-dfff0e865a57 for lustre-OST0001 00000020:00000080:1.0:1788636368.597147:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd75dc5800 for lustre-OST0001 10000000:01000000:2.0:1788636369.349055:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636369.349062:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613ba800 from 7 10000000:01000000:2.0:1788636369.349067:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636369.349136:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.349148:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.349173:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636369.349206:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976371968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636369.349331:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636369.349412:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636369.352849:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976371968 00000100:00100000:0.0:1788636369.352861:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976371968 00000100:00100000:0.0:1788636369.352914:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788636369.352923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976371968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636369.352938:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636369.352956:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7344 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636369.352980:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636369.352991:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636369.353000:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd820fdc00, rc 0) 00000100:00100000:0.0:1788636369.355412:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976371968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2483us (6074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636369.355422:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788636369.367124:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976371968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636369.367153:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.367165:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636369.369888:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636369.370005:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636369.370048:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636369.371398:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976372096 00000100:00100000:2.0:1788636369.371409:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976372096 00000100:00100000:2.0:1788636369.371466:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788636369.371475:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976372096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636369.373353:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976372096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1864us (3334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636369.373365:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788636369.377541:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a6300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636369.377604:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636369.377675:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636369.377835:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc4108a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636369.385454:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976372224 00000100:00100000:0.0:1788636369.385469:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976372224 00000100:00100000:0.0:1788636369.385721:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788636369.385731:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976372224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636369.387414:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976372224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1677us (9731us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636369.387425:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1788636369.387544:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788636369.388627:0:11167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788636369.389124:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788636369.389144:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636369.389155:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636369.389166:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636369.389176:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788636369.389178:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd76a12000 from 7 10000000:01000000:1.0:1788636369.389181:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636369.389214:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636369.389222:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636369.389231:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636369.389264:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636369.389315:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636369.389361:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd759326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636369.389460:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976372352 00000100:00100000:2.0:1788636369.389466:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976372352 00000100:00100000:2.0:1788636369.389509:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788636369.389518:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976372352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636369.389541:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636369.389553:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7352 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.389574:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.389584:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.389593:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ff800, rc 0) 00000100:00100000:2.0:1788636369.389633:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976372352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636369.389639:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788636369.390012:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636369.390026:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636369.390035:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636369.390091:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636369.390116:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636369.390143:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd759326c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636369.390187:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976372480 00000100:00100000:2.0:1788636369.390190:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976372480 00000100:00100000:2.0:1788636369.390217:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788636369.390223:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976372480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636369.390444:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976372480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636369.390450:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1788636369.390630:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636369.390654:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636369.390697:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636369.390713:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd759326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636369.390836:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976372608 00000100:00100000:3.0:1788636369.390840:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976372608 00000100:00100000:3.0:1788636369.390861:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788636369.390867:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976372608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636369.390995:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976372608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 127us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636369.391009:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1788636369.391164:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788636369.395891:0:11168:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788636369.396117:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788636369.396136:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636369.396147:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.396159:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636369.396186:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636369.396188:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613a5000 from 7 10000000:01000000:2.0:1788636369.396190:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636369.396236:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.396244:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.396254:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636369.396277:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636369.396338:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636369.396546:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f89b780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636369.396588:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976372736 00000100:00100000:3.0:1788636369.396596:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976372736 00000100:00100000:3.0:1788636369.396643:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788636369.396652:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976372736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636369.396663:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636369.396675:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa7360 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636369.396707:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636369.396717:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636369.396727:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636369.396776:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976372736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636369.396783:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1788636369.397198:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636369.397216:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636369.397269:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636369.397324:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636369.397642:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636369.397678:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd75932480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636369.397708:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976372864 00000100:00100000:2.0:1788636369.397713:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976372864 00000100:00100000:2.0:1788636369.397746:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788636369.397754:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976372864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636369.398011:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976372864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636369.398019:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788636369.398155:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636369.398187:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636369.398239:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636369.398283:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd75932480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636369.398422:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976372992 00000100:00100000:2.0:1788636369.398427:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976372992 00000100:00100000:2.0:1788636369.398463:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788636369.398470:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976372992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636369.398607:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976372992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636369.398618:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788636369.398744:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81966d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976372992:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788636369.401918:0:11169:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788636369.404721:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788636369.404749:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636369.404761:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636369.404773:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636369.472503:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636369.535949:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976373120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636369.536008:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636369.536620:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976373120 00000100:00100000:3.0:1788636369.536628:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976373120 00000100:00100000:3.0:1788636369.536675:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788636369.536684:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976373120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636369.536714:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636369.537092:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976373120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 409us (1081us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636369.537112:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788636369.537136:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788636369.537199:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b71f80 x1875520976373120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636385 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636369.537219:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976373120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636369.996827:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636369.997042:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963754368 00000100:00100000:3.0:1788636369.997051:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963754368 00000100:00100000:3.0:1788636369.997179:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 236 00000100:00100000:3.0:1788636369.997252:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+11:5600:x1875520963754368:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636369.997272:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636369.997291:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351554d4 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636369.997319:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636369.997332:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636369.997354:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d000, rc 0) 00000100:00100000:3.0:1788636369.997420:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963754368:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 Request processed in 232us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636369.997427:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 236 00000100:00100000:0.0:1788636370.009380:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636370.015116:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963754496 00000100:00100000:2.0:1788636370.015128:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963754496 00000100:00100000:2.0:1788636370.015280:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 237 00000100:00100000:2.0:1788636370.015293:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963754496:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636370.015586:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963754496:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 Request processed in 295us (6213us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636370.017775:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636370.017820:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963754624 00000100:00100000:3.0:1788636370.017828:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963754624 00000100:00100000:2.0:1788636370.024084:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 237 00000100:00100000:3.0:1788636370.024286:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 238 00000100:00100000:3.0:1788636370.024300:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963754624:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636370.024547:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963754624:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 Request processed in 251us (6777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636370.024566:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 238 00000100:00100000:3.0:1788636370.033298:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636370.033656:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963754752 00000100:00100000:1.0:1788636370.033665:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963754752 00000100:00100000:1.0:1788636370.033708:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 239 00000100:00100000:1.0:1788636370.033718:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963754752:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636370.033734:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636370.033751:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351554db expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636370.033778:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636370.033790:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 13 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636370.033815:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167d000, rc 0) 00000100:00100000:1.0:1788636370.033867:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963754752:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 Request processed in 150us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636370.033875:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 239 00000100:00100000:3.0:1788636370.038602:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636370.038839:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963754880 00000100:00100000:1.0:1788636370.038849:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963754880 00000100:00100000:1.0:1788636370.038909:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 240 00000100:00100000:1.0:1788636370.038918:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963754880:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636370.039159:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963754880:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 Request processed in 241us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636370.039167:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 240 00000100:00100000:1.0:1788636370.045933:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636370.046041:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963755008 00000100:00100000:3.0:1788636370.046051:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963755008 00000100:00100000:3.0:1788636370.046101:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 241 00000100:00100000:3.0:1788636370.046111:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963755008:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636370.046318:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963755008:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 Request processed in 207us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636370.046327:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 241 00010000:00010000:0.0:1788636370.496944:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636370.510011:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636370.510060:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636370.510101:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963755264 00000100:00100000:1.0:1788636370.510110:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963755264 00000100:00100000:1.0:1788636370.510167:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963755136 00000100:00100000:1.0:1788636370.510171:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963755136 00000100:00100000:1.0:1788636370.510196:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 83 00000100:00100000:1.0:1788636370.510206:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963755264:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636370.510290:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963755264:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 85us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636370.510298:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 83 00000100:00100000:1.0:1788636370.510313:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:1.0:1788636370.510320:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963755136:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636370.510357:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963755136:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 37us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636370.510364:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00080000:1.0:1788636370.510379:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788636371.521167:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636372.542985:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636372.608512:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976373248:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.608579:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636372.608620:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976373760:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.608654:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636372.608677:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788636372.608683:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976373376:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.608702:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636372.608718:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976373888:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.608739:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636372.608761:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976373504:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.608779:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636372.608810:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636372.608816:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.608849:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636372.608880:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976373248 00000100:00100000:0.0:1788636372.608886:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976373248 00000100:00100000:0.0:1788636372.608926:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788636372.608933:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976373248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.608976:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976373248:12345-0@lo:400:kworker.0 Request processed in 43us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636372.608983:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788636372.609011:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976373760 00000100:00100000:0.0:1788636372.609014:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976373760 00000100:00100000:0.0:1788636372.609041:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976373376 00000100:00100000:0.0:1788636372.609044:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976373376 00000100:00100000:0.0:1788636372.609054:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976373504 00000100:00100000:0.0:1788636372.609056:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976373504 00000100:00100000:0.0:1788636372.609066:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788636372.609071:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976373760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609097:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976373760:12345-0@lo:400:kworker.0 Request processed in 25us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636372.609101:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788636372.609110:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788636372.609114:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976373376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609136:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976373376:12345-0@lo:400:kworker.0 Request processed in 21us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636372.609140:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788636372.609148:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788636372.609153:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976373504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609174:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976373504:12345-0@lo:400:kworker.0 Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636372.609186:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788636372.609204:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976373888 00000100:00100000:0.0:1788636372.609207:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976373888 00000100:00100000:0.0:1788636372.609226:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976373632 00000100:00100000:0.0:1788636372.609228:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976373632 00000100:00100000:0.0:1788636372.609246:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636372.609252:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976373888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609296:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976373888:12345-0@lo:400:kworker.0 Request processed in 44us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636372.609302:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636372.609312:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636372.609317:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976373632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609354:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976373632:12345-0@lo:400:kworker.0 Request processed in 37us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636372.609360:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1788636372.609383:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636372.609386:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636372.609388:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788636372.609420:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b71500 x1875520976373632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636372.609433:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976373632:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609444:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976373504:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609467:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976373376:0@lo:400:kworker.0 00010000:00080000:0.0:1788636372.609478:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b73b80 x1875520976373888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636372.609496:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976373888:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609506:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976373248:0@lo:400:kworker.0 00000100:00100000:0.0:1788636372.609515:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976373760:0@lo:400:kworker.0 00000001:02000400:2.0:1788636372.908153:0:11345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1788636373.119033:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976374016:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636373.119098:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636373.119335:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976374016 00000100:00100000:3.0:1788636373.119342:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976374016 00000100:00100000:3.0:1788636373.119391:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788636373.119400:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976374016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636373.119441:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636373.119496:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976374016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636373.119503:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1788636373.119569:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75bd7100 x1875520976374016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636373.119587:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976374016:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636373.566905:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636374.591063:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636374.656385:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636374.656407:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976374144:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636374.656481:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636374.656522:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976374144 00000100:00100000:2.0:1788636374.656530:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976374144 00000100:00080000:0.0:1788636374.656573:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636374.656592:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788636374.656603:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976374144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636374.656636:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636374.656739:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976374144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636374.656762:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788636374.656912:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b71f80 x1875520976374144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636374.656930:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976374144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788636375.617095:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636375.629261:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636375.629313:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636375.629341:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636375.629366:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963755648 00000100:00100000:0.0:1788636375.629375:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963755648 00000100:00100000:0.0:1788636375.629437:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963755520 00000100:00100000:0.0:1788636375.629447:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963755520 00000100:00100000:0.0:1788636375.629485:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 88 00000100:00100000:0.0:1788636375.629496:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963755648:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636375.630029:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963755648:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 533us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636375.630038:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 88 00000100:00100000:0.0:1788636375.630058:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 89 00000100:00100000:0.0:1788636375.630198:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963755520:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636375.630234:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963755520:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 170us (892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636375.630241:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 89 00000100:00080000:0.0:1788636375.630264:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636375.631333:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963755392 00000100:00100000:1.0:1788636375.631342:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963755392 00000100:00100000:1.0:1788636375.631392:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 243 00000100:00100000:1.0:1788636375.631401:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2362:x1875520963755392:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636375.631454:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2362:x1875520963755392:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 55us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636375.631461:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 243 00010000:00010000:0.0:1788636376.639050:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788636377.411687:0:11445:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 15:26:16 (1788636376) === 00000100:00100000:1.0:1788636377.606633:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636377.606689:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636377.606755:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963755776 00000100:00100000:3.0:1788636377.606765:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963755776 00000100:00100000:3.0:1788636377.606990:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:3.0:1788636377.607054:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963755776:12345-192.168.203.57@tcp:41:mkdir.0 00000004:00000024:3.0:1788636377.607097:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788636377.607173:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963755776:12345-192.168.203.57@tcp:41:mkdir.0 Request processed in 171us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636377.607188:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:0.0:1788636377.607281:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963755904 00000100:00100000:0.0:1788636377.607286:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963755904 00000100:00100000:0.0:1788636377.607332:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:0.0:1788636377.607340:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:38630149-ece4-4de3-88b1-a62e16a39489+6:9692:x1875520963755904:12345-192.168.203.57@tcp:700:mkdir.0 00000100:00100000:0.0:1788636377.607372:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:38630149-ece4-4de3-88b1-a62e16a39489+6:9692:x1875520963755904:12345-192.168.203.57@tcp:700:mkdir.0 Request processed in 34us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.607379:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00080000:1.0:1788636377.607697:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636377.612906:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636377.613056:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963756160 00000100:00100000:3.0:1788636377.613065:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963756160 00000100:00100000:3.0:1788636377.613116:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:3.0:1788636377.613126:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:9692:x1875520963756160:12345-192.168.203.57@tcp:36:mkdir.0 00010000:00010000:3.0:1788636377.613180:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636377.613253:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa725d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515545d expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.613270:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500ebe00) 00010000:00010000:3.0:1788636377.613282:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636377.613577:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.613592:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.613602:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.613630:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.613639:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.613646:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636377.615943:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788636377.615967:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.615977:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.615984:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.615991:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.615996:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.616004:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.616020:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85600) 00010000:00010000:3.0:1788636377.616023:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636377.616027:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.616034:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa737c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636377.616051:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005fb90e7e reply state 00000000b0c071e4 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636377.616059:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636377.616151:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:9692:x1875520963756160:12345-192.168.203.57@tcp:36:mkdir.0 Request processed in 3023us (3247us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788636377.616159:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 15 00010000:00010000:3.0:1788636377.622792:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.622845:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.622949:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.622956:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.622961:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.622969:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.622984:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cfd42a85700) 00010000:00010000:3.0:1788636377.622988:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636377.622993:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.623000:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7383 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636377.632673:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.632927:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963756288 00000100:00100000:0.0:1788636377.632936:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963756288 00000100:00100000:0.0:1788636377.632997:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:0.0:1788636377.633007:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:9694:x1875520963756288:12345-192.168.203.57@tcp:101:chmod.0 00010000:00010000:0.0:1788636377.633030:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636377.633062:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa738a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351554e2 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.633128:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7391 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.633203:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.633218:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636377.633253:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788636377.633257:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636377.633306:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7391 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.633333:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa738a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554e2 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.633352:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7391 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554e2 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.633360:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500eba00) 00010000:00010000:0.0:1788636377.633363:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636377.633367:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031000, rc 0) 00000100:00100000:0.0:1788636377.633521:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:9694:x1875520963756288:12345-192.168.203.57@tcp:101:chmod.0 Request processed in 514us (857us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.633528:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:0.0:1788636377.636461:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636377.636545:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963756544 00000100:00100000:3.0:1788636377.636555:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963756544 00000100:00100000:3.0:1788636377.636658:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:3.0:1788636377.636669:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:9694:x1875520963756544:12345-192.168.203.57@tcp:36:chmod.0 00010000:00010000:3.0:1788636377.636719:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636377.636743:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7391 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554e2 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.636773:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500eba00) 00010000:00010000:3.0:1788636377.636784:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636377.637032:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.637046:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.637056:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636377.637423:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000065b51ade reply state 00000000314f647a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636377.637433:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788636377.637440:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788636377.637558:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+8:9694:x1875520963756544:12345-192.168.203.57@tcp:36:chmod.0 Request processed in 891us (1105us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788636377.637565:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 17 00010000:00010000:3.0:1788636377.639442:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.639457:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.639467:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.639472:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.639477:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.639498:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.639512:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85700) 00010000:00010000:3.0:1788636377.639516:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636377.639520:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.639527:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7398 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636377.660524:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.661462:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963756672 00000100:00100000:0.0:1788636377.661472:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963756672 00000100:00100000:0.0:1788636377.661539:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:0.0:1788636377.661734:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+7:9695:x1875520963756672:12345-192.168.203.57@tcp:101:chown.0 00010000:00010000:0.0:1788636377.661757:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636377.661781:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa739f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351554e9 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.661939:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031600/0xa6aa59fb12fa73a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.661952:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031600/0xa6aa59fb12fa73a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.661964:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031600/0xa6aa59fb12fa73a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636377.661996:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788636377.661999:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636377.662033:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031600/0xa6aa59fb12fa73a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.662056:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa739f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554e9 expref: 9 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.662075:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031600/0xa6aa59fb12fa73a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554e9 expref: 8 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.662084:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500eb400) 00010000:00010000:0.0:1788636377.662087:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636377.662103:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031600, rc 0) 00000100:00100000:0.0:1788636377.662164:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+8:9695:x1875520963756672:12345-192.168.203.57@tcp:101:chown.0 Request processed in 617us (1649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.662172:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 18 00010000:00010000:3.0:1788636377.664587:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636377.665000:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.665093:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963756800 00000100:00100000:0.0:1788636377.665102:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963756800 00000100:00100000:0.0:1788636377.665243:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:0.0:1788636377.665254:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:9695:x1875520963756800:12345-192.168.203.57@tcp:101:chown.0 00010000:00010000:0.0:1788636377.665271:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636377.665298:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa73ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351554f0 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665358:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665371:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665382:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665491:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665501:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665509:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665590:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa73c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665613:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa73c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665621:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa73c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636377.665649:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788636377.665652:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636377.665669:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa73c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665680:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665686:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665692:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665697:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40031000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636377.665701:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665708:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665720:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500eb400) 00010000:00010000:0.0:1788636377.665723:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636377.665784:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665830:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa73b4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665844:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665912:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665920:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665925:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40031e00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636377.665928:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665935:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665943:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cfd500eb800) 00010000:00010000:0.0:1788636377.665946:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636377.665949:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665955:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa73bb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.665986:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa73ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554f0 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.666002:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa73c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554f0 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.666016:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd500eb600) 00010000:00010000:0.0:1788636377.666018:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636377.666021:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40030600, rc 0) 00000100:00100000:0.0:1788636377.666122:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:9695:x1875520963756800:12345-192.168.203.57@tcp:101:chown.0 Request processed in 870us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.666130:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:1.0:1788636377.669371:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636377.669490:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963757056 00000100:00100000:3.0:1788636377.669501:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963757056 00000100:00100000:3.0:1788636377.669558:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:3.0:1788636377.669569:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+9:9695:x1875520963757056:12345-192.168.203.57@tcp:36:chown.0 00010000:00010000:3.0:1788636377.669622:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636377.669644:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa73c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554f0 expref: 9 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.669664:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd500eb600) 00010000:00010000:3.0:1788636377.669673:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636377.669694:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.669706:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.669715:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636377.719824:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:0.0:1788636377.720033:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004e82f816 reply state 0000000038304d5c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636377.720047:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788636377.720062:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:0.0:1788636377.720181:0:5812:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:0.0:1788636377.720201:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:9695:x1875520963757056:12345-192.168.203.57@tcp:36:chown.0 Request processed in 50631us (50834us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788636377.720210:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 20 00010000:00010000:3.0:1788636377.720275:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.720283:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.720300:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.720307:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.720311:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.720320:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.720334:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd42a85700) 00010000:00010000:3.0:1788636377.720338:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636377.720342:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.720348:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636377.727497:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976374528:0@lo:400:kworker.0 00000100:00100000:1.0:1788636377.727560:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636377.727671:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976374272:0@lo:400:kworker.0 00000100:00100000:2.0:1788636377.727708:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636377.727741:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636377.727748:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976374400:0@lo:400:kworker.0 00000100:00100000:2.0:1788636377.727773:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636377.727821:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976374272 00000100:00100000:2.0:1788636377.727829:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976374272 00000100:00100000:2.0:1788636377.728110:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788636377.728120:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976374272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636377.728174:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976374272:12345-0@lo:400:kworker.0 Request processed in 55us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636377.728181:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1788636377.728214:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976374528 00000100:00100000:2.0:1788636377.728218:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976374528 00000100:00100000:2.0:1788636377.728253:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976374400 00000100:00100000:2.0:1788636377.728256:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976374400 00000100:00100000:2.0:1788636377.728275:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788636377.728283:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976374528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636377.729354:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976374912:0@lo:400:kworker.0 00000100:00100000:3.0:1788636377.729453:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636377.729514:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976374912 00000100:00100000:0.0:1788636377.729519:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976374912 00000100:00100000:0.0:1788636377.729557:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636377.729565:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976374912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636377.729610:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976374912:12345-0@lo:400:kworker.0 Request processed in 47us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.729617:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1788636377.729779:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b72a00 x1875520976374912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636377.729792:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976374912:0@lo:400:kworker.0 00000100:00100000:3.0:1788636377.729849:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636377.729856:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976374784:0@lo:400:kworker.0 00000100:00100000:3.0:1788636377.729882:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788636377.731516:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636377.731524:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636377.731544:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976374656:0@lo:400:kworker.0 00000100:00100000:3.0:1788636377.731601:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636377.731683:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976374272:0@lo:400:kworker.0 00000100:00100000:0.0:1788636377.731773:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976374656 00000100:00100000:0.0:1788636377.731780:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976374656 00000100:00100000:0.0:1788636377.731852:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636377.731870:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976374656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636377.731933:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976374656:12345-0@lo:400:kworker.0 Request processed in 73us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.731940:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636377.732858:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976374784 00000100:00100000:0.0:1788636377.732865:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976374784 00000100:00100000:0.0:1788636377.732898:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788636377.732906:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976374400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636377.732959:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976374400:12345-0@lo:400:kworker.0 Request processed in 54us (5186us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.733170:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788636377.733189:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788636377.733196:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976374784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636377.733233:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976374784:12345-0@lo:400:kworker.0 Request processed in 38us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.733239:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:3.0:1788636377.734102:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636377.734110:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636377.734161:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b71180 x1875520976374656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636377.734175:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976374656:0@lo:400:kworker.0 00000100:00100000:3.0:1788636377.734215:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976374400:0@lo:400:kworker.0 00000100:00100000:3.0:1788636377.734241:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976374784:0@lo:400:kworker.0 00000100:00100000:2.0:1788636377.754868:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976374528:12345-0@lo:400:kworker.0 Request processed in 26576us (27297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636377.754884:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788636377.755107:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976374528:0@lo:400:kworker.0 00000100:00100000:1.0:1788636377.757651:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.757873:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963757184 00000100:00100000:0.0:1788636377.757882:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963757184 00000100:00100000:0.0:1788636377.757943:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:0.0:1788636377.757953:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:9696:x1875520963757184:12345-192.168.203.57@tcp:101:touch.500 00010000:00010000:0.0:1788636377.757975:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636377.757995:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa73d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351554f7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636377.759926:0:5811:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1882us 00010000:00010000:1.0:1788636377.776783:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.776833:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.776847:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.776863:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.776871:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.776878:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777153:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167d600/0xa6aa59fb12fa73e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777171:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167d600/0xa6aa59fb12fa73e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777178:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167d600/0xa6aa59fb12fa73e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636377.777201:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788636377.777205:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636377.777238:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167d600/0xa6aa59fb12fa73e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777250:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777256:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777262:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777268:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636377.777272:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777279:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777303:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500eb400) 00010000:00010000:1.0:1788636377.777307:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636377.777311:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777327:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c400/0xa6aa59fb12fa73d7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777339:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777345:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777351:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777356:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167c800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636377.777359:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777365:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777372:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cfd5a43c200) 00010000:00010000:1.0:1788636377.777375:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636377.777377:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777383:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167c800/0xa6aa59fb12fa73de lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777428:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa73d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554f7 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777445:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167d600/0xa6aa59fb12fa73e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554f7 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.777468:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:1.0:1788636377.777470:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788636377.777473:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd4167d600, rc 0) 00000100:00100000:1.0:1788636377.777539:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:9696:x1875520963757184:12345-192.168.203.57@tcp:101:touch.500 Request processed in 19587us (19896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636377.777547:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:2.0:1788636377.782171:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636377.782310:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963757440 00000100:00100000:3.0:1788636377.782320:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963757440 00000100:00100000:3.0:1788636377.782378:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:3.0:1788636377.782387:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:9696:x1875520963757440:12345-192.168.203.57@tcp:101:touch.500 00010000:00010000:3.0:1788636377.782547:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636377.782567:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351554fe expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.782829:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.782854:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.782866:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.782881:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.782889:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.782895:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788636377.783935:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788636377.784913:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7401 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.784927:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.784937:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7401 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.784970:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.784978:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.784984:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.785000:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.785014:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.785022:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.785034:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:3.0:1788636377.785037:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636377.785042:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.785048:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa73f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636377.785060:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cde753b9 reply state 00000000276ad8f1 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636377.785068:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788636377.785100:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa73ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554fe expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.785115:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7401 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554fe expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.785122:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cfd42a85300) 00010000:00010000:3.0:1788636377.785123:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636377.785126:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997ca00, rc 0) 00000100:00100000:3.0:1788636377.785349:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+10:9696:x1875520963757440:12345-192.168.203.57@tcp:101:touch.500 Request processed in 2962us (3187us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788636377.785364:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 22 00010000:00010000:3.0:1788636377.787258:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.787272:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.787280:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.787285:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.787299:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.787307:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.787322:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff9cfd42a85700) 00010000:00010000:3.0:1788636377.787326:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636377.787330:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.787336:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa73fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636377.789898:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636377.789991:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963757696 00000100:00100000:1.0:1788636377.790000:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963757696 00000100:00100000:1.0:1788636377.790060:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:1.0:1788636377.790070:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+9:9696:x1875520963757696:12345-192.168.203.57@tcp:36:touch.500 00010000:00010000:1.0:1788636377.790119:0:7975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636377.790159:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7401 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554fe expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.790177:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cfd42a85300) 00010000:00010000:1.0:1788636377.790185:0:7975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636377.790224:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.790237:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.790247:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636377.790381:0:7975:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d96735ef reply state 0000000012dc4e6a transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636377.790408:0:7975:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636377.790504:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+10:9696:x1875520963757696:12345-192.168.203.57@tcp:36:touch.500 Request processed in 434us (613us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788636377.790511:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:1.0:1788636377.795584:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00010000:00010000:3.0:1788636377.797133:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.797147:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.797186:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.797192:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.797197:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.797206:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.797222:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:3.0:1788636377.797226:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636377.797231:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.797237:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa740f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636377.803434:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963757824 00000100:00100000:2.0:1788636377.803450:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963757824 00000100:00100000:2.0:1788636377.803545:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:2.0:1788636377.803555:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:9696:x1875520963757824:12345-192.168.203.57@tcp:101:touch.500 00010000:00010000:2.0:1788636377.803579:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636377.803605:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffa00/0xa6aa59fb12fa7416 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155505 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636377.803658:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffa00/0xa6aa59fb12fa7416 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155505 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636377.803674:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffa00/0xa6aa59fb12fa7416 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155505 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636377.803692:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636377.803695:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636377.803699:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ffa00, rc 0) 00000100:00100000:2.0:1788636377.803773:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+10:9696:x1875520963757824:12345-192.168.203.57@tcp:101:touch.500 Request processed in 220us (8197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636377.803780:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:2.0:1788636377.808228:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.808348:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963757952 00000100:00100000:0.0:1788636377.808356:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963757952 00000100:00100000:0.0:1788636377.808415:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:0.0:1788636377.808424:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1875520963757952:12345-192.168.203.57@tcp:8:touch.500 00010000:00080000:0.0:1788636377.808545:0:6963:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp t0 exp 0000000000000000 cur 246 last 0 00000020:00000080:0.0:1788636377.808574:0:6963:0:(genops.c:1385:class_connect()) connect: client 38630149-ece4-4de3-88b1-a62e16a39489, cookie 0xa6aa59fb12fa741d 00002000:00100000:0.0:1788636377.808586:0:6963:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 38630149-ece4-4de3-88b1-a62e16a39489/ffff9cfd75dc7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788636377.808610:0:6963:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788636377.808928:0:6963:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788636377.808959:0:6963:0:(import.c:65:import_set_state_nolock()) ffff9cfd75dc4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636377.809028:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2359:x1875520963757952:12345-192.168.203.57@tcp:8:touch.500 Request processed in 604us (808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.809036:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:1.0:1788636377.824442:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.824979:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963758080 00000100:00100000:0.0:1788636377.824988:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963758080 00000100:00100000:0.0:1788636377.825065:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:0.0:1788636377.825074:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:0:x1875520963758080:12345-192.168.203.57@tcp:2:touch.500 00000100:00080000:3.0:1788636377.825213:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636377.863900:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:0:x1875520963758080:12345-192.168.203.57@tcp:2:touch.500 Request processed in 38817us (39457us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788636377.863912:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 17 00000001:00080000:3.0:1788636377.864222:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:3.0:1788636377.864232:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000100:00100000:1.0:1788636377.866832:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636377.866900:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963758336 00000100:00100000:2.0:1788636377.866909:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963758336 00000100:00100000:2.0:1788636377.866987:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:2.0:1788636377.866996:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+10:9696:x1875520963758336:12345-192.168.203.57@tcp:35:touch.500 00000100:00100000:2.0:1788636377.867309:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+11:9696:x1875520963758336:12345-192.168.203.57@tcp:35:touch.500 Request processed in 314us (586us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788636377.867330:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:2.0:1788636377.877368:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636377.877611:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963758464 00000100:00100000:1.0:1788636377.877621:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963758464 00000100:00100000:1.0:1788636377.877724:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:1.0:1788636377.877844:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+11:9697:x1875520963758464:12345-192.168.203.57@tcp:101:rm.0 00010000:00010000:1.0:1788636377.877867:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636377.877888:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7424 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515550c expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.877957:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa742b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.877971:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa742b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.877982:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa742b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636377.878015:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788636377.878018:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636377.878055:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa742b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.878100:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7424 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515550c expref: 13 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.878118:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa742b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515550c expref: 12 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636377.878127:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:1.0:1788636377.878130:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636377.878134:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a800, rc 0) 00000100:00100000:1.0:1788636377.878199:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+12:9697:x1875520963758464:12345-192.168.203.57@tcp:101:rm.0 Request processed in 360us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636377.878207:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:3.0:1788636377.881572:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636377.881690:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963758720 00000100:00100000:2.0:1788636377.881699:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963758720 00000100:00100000:2.0:1788636377.881765:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:2.0:1788636377.881775:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+12:9697:x1875520963758720:12345-192.168.203.57@tcp:101:rm.0 00010000:00010000:2.0:1788636377.881792:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636377.882085:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7432 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155513 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636377.882182:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788636377.882342:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7432 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155513 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.882357:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500eb400) 00010000:00010000:0.0:1788636377.882364:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636377.882370:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7432 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155513 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.882384:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031e00, rc 0) 00000100:00100000:0.0:1788636377.882454:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+13:9697:x1875520963758720:12345-192.168.203.57@tcp:101:rm.0 Request processed in 681us (890us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1788636377.882461:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:2.0:1788636377.886971:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636377.887048:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963758848 00000100:00100000:1.0:1788636377.887058:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963758848 00000100:00100000:1.0:1788636377.887118:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:1.0:1788636377.887128:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+13:9697:x1875520963758848:12345-192.168.203.57@tcp:37:rm.0 00000100:00100000:3.0:1788636377.891587:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+13:9697:x1875520963758848:12345-192.168.203.57@tcp:37:rm.0 Request processed in 4452us (4617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636377.891599:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:1.0:1788636377.898296:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636377.898355:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963759104 00000100:00100000:2.0:1788636377.898364:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963759104 00000100:00100000:2.0:1788636377.898419:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:2.0:1788636377.898428:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd48418850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+13:9697:x1875520963759104:12345-192.168.203.57@tcp:35:rm.0 00000100:00100000:2.0:1788636377.898640:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd48418850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:9697:x1875520963759104:12345-192.168.203.57@tcp:35:rm.0 Request processed in 213us (363us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788636377.898648:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:2.0:1788636377.902049:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.902146:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963759360 00000100:00100000:0.0:1788636377.902155:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963759360 00000100:00100000:0.0:1788636377.902211:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:0.0:1788636377.902221:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+14:9697:x1875520963759360:12345-192.168.203.57@tcp:101:rm.0 00010000:00010000:0.0:1788636377.902242:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636377.902261:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7440 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515551a expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.902360:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7447 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.902374:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7447 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.902385:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7447 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636377.902395:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788636377.902522:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7440 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515551a expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.902539:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7447 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515551a expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.902560:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:0.0:1788636377.902563:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788636377.902567:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031000, rc 0) 00000100:00100000:0.0:1788636377.902622:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+16:9697:x1875520963759360:12345-192.168.203.57@tcp:101:rm.0 Request processed in 403us (581us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788636377.902629:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:1.0:1788636377.905711:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636377.905790:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963759488 00000100:00100000:3.0:1788636377.905828:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963759488 00000100:00100000:3.0:1788636377.905878:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 28 00000100:00100000:3.0:1788636377.905889:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+16:9697:x1875520963759488:12345-192.168.203.57@tcp:41:rm.0 00000004:00000024:3.0:1788636377.905956:0:5812:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788636377.906072:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+16:9697:x1875520963759488:12345-192.168.203.57@tcp:41:rm.0 Request processed in 184us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636377.906079:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 28 00000100:00100000:3.0:1788636377.908743:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.908835:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963759616 00000100:00100000:0.0:1788636377.908845:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963759616 00000100:00100000:0.0:1788636377.908900:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 29 00000100:00100000:0.0:1788636377.908910:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+16:9697:x1875520963759616:12345-192.168.203.57@tcp:101:rm.0 00010000:00010000:0.0:1788636377.908935:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636377.908955:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7455 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155521 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909014:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909028:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909039:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909065:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909073:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909098:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909203:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa746a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909212:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa746a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909219:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa746a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636377.909244:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788636377.909249:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636377.909265:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa746a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909277:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa746a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909296:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909303:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909309:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909315:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40030a00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636377.909319:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909335:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909347:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:0.0:1788636377.909351:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636377.909356:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909363:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa745c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909378:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909384:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909390:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909405:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40030e00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636377.909408:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909414:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909421:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636377.909424:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636377.909427:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909442:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7463 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909473:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7455 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155521 expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909486:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa746a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155521 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.909493:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:0.0:1788636377.909496:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636377.909498:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40030600, rc 0) 00000100:00100000:0.0:1788636377.909561:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+17:9697:x1875520963759616:12345-192.168.203.57@tcp:101:rm.0 Request processed in 652us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636377.909567:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 29 00000100:00100000:2.0:1788636377.913237:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636377.913321:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963759872 00000100:00100000:3.0:1788636377.913331:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963759872 00000100:00100000:3.0:1788636377.913384:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:3.0:1788636377.913394:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+17:9697:x1875520963759872:12345-192.168.203.57@tcp:36:rm.0 00010000:00010000:3.0:1788636377.913449:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788636377.913473:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030600/0xa6aa59fb12fa746a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155521 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913495:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffa00/0xa6aa59fb12fa7416 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155505 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913509:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:3.0:1788636377.913523:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa742b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515550c expref: 15 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913531:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:3.0:1788636377.913534:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636377.913552:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913564:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913592:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913607:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913613:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913618:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913974:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913984:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.913991:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636377.914672:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788636377.914682:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 246938885760ns, next at 247938883619ns, rc = 0 00010000:00010000:3.0:1788636377.915068:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915079:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915087:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915104:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915110:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915115:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915171:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636377.915190:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915196:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915202:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915207:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.915211:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915218:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915228:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cfd42a85700) 00010000:00010000:3.0:1788636377.915231:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788636377.915235:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915261:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa747f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915278:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915283:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915300:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915305:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.915308:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915313:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915320:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:3.0:1788636377.915322:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636377.915324:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.915329:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7471 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636377.915338:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000de849644 reply state 000000003a7f9300 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636377.915345:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636377.915438:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+16:9697:x1875520963759872:12345-192.168.203.57@tcp:36:rm.0 Request processed in 2044us (2206us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788636377.915446:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 30 00010000:00010000:0.0:1788636377.916479:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636377.916487:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.916495:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636377.916498:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.916506:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.916518:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cfd42a85700) 00010000:00010000:0.0:1788636377.916521:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788636377.916536:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.916541:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7486 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.916557:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636377.916559:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636377.916561:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636377.918092:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.918106:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.918113:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.918118:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.918121:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.918127:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.918150:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff9cfd42a85600) 00010000:00010000:3.0:1788636377.918153:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636377.918158:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.918164:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997de00/0xa6aa59fb12fa7478 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636377.920688:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.921024:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963760128 00000100:00100000:0.0:1788636377.921032:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963760128 00000100:00100000:0.0:1788636377.921089:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:0.0:1788636377.921098:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+15:9697:x1875520963760128:12345-192.168.203.57@tcp:35:rm.0 00000100:00100000:0.0:1788636377.921329:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+16:9697:x1875520963760128:12345-192.168.203.57@tcp:35:rm.0 Request processed in 231us (648us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788636377.921336:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:2.0:1788636377.924541:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636377.924613:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963760384 00000100:00100000:0.0:1788636377.924622:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963760384 00000100:00100000:0.0:1788636377.924682:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 31 00000100:00100000:0.0:1788636377.924692:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+16:9697:x1875520963760384:12345-192.168.203.57@tcp:36:rm.0 00010000:00010000:0.0:1788636377.924761:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788636377.924789:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031000/0xa6aa59fb12fa7447 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515551a expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.924851:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd4167d600/0xa6aa59fb12fa73e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554f7 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.924862:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:0.0:1788636377.924892:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031600/0xa6aa59fb12fa73a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554e9 expref: 14 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.924902:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500eb400) 00010000:00010000:0.0:1788636377.924909:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636377.924933:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.924946:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.924956:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.924967:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.924973:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.924980:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925206:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925215:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925222:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636377.925752:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788636377.925772:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925780:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925786:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925791:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40030a00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636377.925820:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925830:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925839:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cfd500eba00) 00010000:00010000:0.0:1788636377.925843:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788636377.925847:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925853:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030a00/0xa6aa59fb12fa749b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925873:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925880:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925885:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925890:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40031e00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636377.925900:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925907:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925915:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636377.925918:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636377.925921:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636377.925926:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa748d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636377.925938:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001767504f reply state 00000000260b46a5 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636377.925947:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788636377.926018:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+15:9697:x1875520963760384:12345-192.168.203.57@tcp:36:rm.0 Request processed in 1327us (1484us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788636377.926026:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 31 00010000:00010000:3.0:1788636377.928362:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.928376:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.928408:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.928415:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40030e00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636377.928419:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.928427:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.928441:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cfd500eb800) 00010000:00010000:3.0:1788636377.928445:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636377.928449:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636377.928455:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa7494 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636378.240330:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788636378.240352:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976375040:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636378.240420:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636378.240537:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976375040 00000100:00100000:3.0:1788636378.240545:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976375040 00000100:00100000:3.0:1788636378.240598:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788636378.240608:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976375040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636378.240629:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636378.240686:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976375040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636378.240693:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:2.0:1788636378.240980:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6a336a00 x1875520976375040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636378.241000:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976375040:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636378.687344:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636379.717915:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636379.775971:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636379.776005:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976375168:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636379.776087:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636379.776261:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976375168 00000100:00100000:0.0:1788636379.776269:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976375168 00000100:00100000:0.0:1788636379.776338:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788636379.776348:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976375168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636379.776394:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636379.776455:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976375168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636379.776462:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1788636379.776519:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636379.776553:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd69b72680 x1875520976375168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636395 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636379.776573:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976375168:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788636380.735308:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636380.750326:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636380.750537:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963760512 00000100:00100000:0.0:1788636380.750549:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963760512 00000100:00100000:0.0:1788636380.750615:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 245 00000100:00100000:0.0:1788636380.750627:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963760512:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636380.750714:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963760512:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 90us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636380.750722:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 245 00000100:00100000:0.0:1788636380.757711:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636380.757767:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636380.757870:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636380.757910:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963760768 00000100:00100000:0.0:1788636380.757922:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963760768 00000100:00100000:2.0:1788636380.757967:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963760640 00000100:00100000:2.0:1788636380.757974:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963760640 00000100:00100000:0.0:1788636380.758003:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 55 00000100:00100000:0.0:1788636380.758018:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963760768:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636380.758023:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963760896 00000100:00100000:2.0:1788636380.758028:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963760896 00000100:00100000:2.0:1788636380.758057:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 93 00000100:00100000:2.0:1788636380.758067:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:2363:x1875520963760640:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636380.758161:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 94 00000100:00100000:3.0:1788636380.758174:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963760896:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636380.758226:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963760896:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 56us (458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636380.758233:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 94 00000100:00100000:2.0:1788636380.758279:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:2363:x1875520963760640:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 213us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636380.758288:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 93 00000100:00080000:3.0:1788636380.758335:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636380.758341:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636380.758702:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963760768:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 688us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636380.758711:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 55 00010000:00010000:0.0:1788636381.758987:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636382.783214:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636382.848712:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976375296:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.848839:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636382.848899:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976375808:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.848933:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636382.848969:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788636382.848975:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976375424:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.848997:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636382.849028:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976375936:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849057:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636382.849089:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976375552:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849113:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636382.849132:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636382.849137:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976375680:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849156:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636382.849191:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976375296 00000100:00100000:0.0:1788636382.849200:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976375296 00000100:00100000:0.0:1788636382.849267:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788636382.849278:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976375296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849338:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976375296:12345-0@lo:400:kworker.0 Request processed in 62us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636382.849346:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788636382.849464:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976375808 00000100:00100000:0.0:1788636382.849469:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976375808 00000100:00100000:0.0:1788636382.849510:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976375424 00000100:00100000:0.0:1788636382.849514:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976375424 00000100:00100000:0.0:1788636382.849527:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976375552 00000100:00100000:0.0:1788636382.849529:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976375552 00000100:00100000:0.0:1788636382.849544:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788636382.849550:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976375808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849586:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976375808:12345-0@lo:400:kworker.0 Request processed in 36us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636382.849592:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788636382.849604:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788636382.849610:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976375424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849653:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976375424:12345-0@lo:400:kworker.0 Request processed in 43us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636382.849659:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788636382.849672:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788636382.849678:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976375552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849712:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976375552:12345-0@lo:400:kworker.0 Request processed in 34us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636382.849718:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788636382.849742:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976375936 00000100:00100000:0.0:1788636382.849746:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976375936 00000100:00100000:0.0:1788636382.849775:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976375680 00000100:00100000:0.0:1788636382.849778:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976375680 00000100:00100000:0.0:1788636382.849825:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636382.849832:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976375936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849865:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75972680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976375936:12345-0@lo:400:kworker.0 Request processed in 35us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636382.849871:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788636382.849883:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788636382.849889:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976375680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.849915:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976375680:12345-0@lo:400:kworker.0 Request processed in 27us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636382.849921:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1788636382.849952:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636382.849957:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636382.849959:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788636382.850003:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75973100 x1875520976375680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636382.850036:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976375680:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.850052:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976375552:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.850087:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976375424:0@lo:400:kworker.0 00010000:00080000:0.0:1788636382.850099:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75971180 x1875520976375936/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636382.850109:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976375936:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.850120:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976375296:0@lo:400:kworker.0 00000100:00100000:0.0:1788636382.850131:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976375808:0@lo:400:kworker.0 00000001:00080000:0.0:1788636382.938438:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:0.0:1788636382.938474:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788636382.938643:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976376064:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788636382.938713:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636382.938752:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976376064 00000100:00100000:1.0:1788636382.938761:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976376064 00000100:00100000:1.0:1788636382.938833:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788636382.938843:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976376064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788636382.938869:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788636382.938900:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9c6cda, atime: 0x6a9c6cda, ctime: 0x6a9c6cda, blocks: 0x1 00010000:00010000:1.0:1788636382.938908:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636382.938931:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=251s v=(0 0) 00010000:00010000:1.0:1788636382.938935:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636382.938940:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636382.938954:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636382.938961:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636382.938965:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636382.938980:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636382.938999:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636382.939005:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636382.939012:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636382.939017:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636382.939025:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636382.939051:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636382.939059:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa74a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636382.939074:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636382.939076:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636382.939078:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636382.939528:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976376064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 685us (812us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788636382.939536:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:0.0:1788636382.939564:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd5d295f80/2, rc 0, transno 4294967300 00000100:00100000:0.0:1788636382.939569:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976376064:0@lo:6:osp-syn-1-0.0 00000001:02000400:1.0:1788636383.050631:0:11596:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:1.0:1788636383.362201:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976376192:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636383.362283:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636383.362412:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976376192 00000100:00100000:0.0:1788636383.362420:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976376192 00000100:00100000:0.0:1788636383.362476:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788636383.362487:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875520976376192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636383.362519:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636383.362571:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3283:x1875520976376192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636383.362580:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788636383.362627:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976376192:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636383.811017:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788636384.182926:0:11644:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd558d6820 20000000:00000080:0.0:1788636384.182942:0:11644:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cfd7fcbb000 uarg=0000000000000000 20000000:01000000:0.0:1788636384.182978:0:11644:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788636384.182983:0:11644:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1788636384.182992:0:11644:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1788636384.184489:0:11645:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788636384.184580:0:11644:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788636384.189158:0:11644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788636384.189215:0:11644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788636384.189281:0:11644:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788636384.189302:0:11644:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788636384.189320:0:11644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189339:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189347:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189415:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189435:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189442:0:11644:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189449:0:11644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189485:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189499:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 12 pid: 5803 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636384.189512:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a334a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376320:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636384.189608:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 12 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189616:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 12 pid: 5804 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636384.189624:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376448:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636384.189651:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 18 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.189659:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 18 pid: 5803 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636384.189678:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a334380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376576:0@lo:104: 00000100:00100000:3.0:1788636384.189713:0:11644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636384.189833:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976376576 00000100:00100000:2.0:1788636384.189843:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976376576 00010000:00010000:3.0:1788636384.189850:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636384.189894:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636384.189904:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:11644:x1875520976376576:12345-0@lo:104: 00010000:00010000:3.0:1788636384.189919:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 18 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.189919:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636384.189944:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376704:0@lo:104: 00000100:00100000:3.0:1788636384.189977:0:11644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788636384.189992:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636384.190000:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:11644:x1875520976376576:12345-0@lo:104: Request processed in 97us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636384.190141:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636384.190664:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976376704 00000100:00100000:2.0:1788636384.190669:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976376704 00010000:00010000:3.0:1788636384.190685:0:11644:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636384.190694:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788636384.190702:0:11644:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 18 pid: 5804 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636384.190706:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:11644:x1875520976376704:12345-0@lo:104: 00000100:00100000:3.0:1788636384.190721:0:11644:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376832:0@lo:104: 00010000:00010000:2.0:1788636384.190723:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636384.190751:0:11644:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636384.190760:0:11644:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fa0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636384.190779:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a334380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376576:0@lo:104: 00010000:00010000:2.0:1788636384.190874:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788636384.190880:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:11644:x1875520976376704:12345-0@lo:104: Request processed in 178us (903us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636384.190887:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788636384.190908:0:5794:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788636384.190919:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976376832 00000100:00100000:2.0:1788636384.190922:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976376832 00000100:00100000:2.0:1788636384.190942:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788636384.190949:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:11644:x1875520976376832:12345-0@lo:104: 00010000:00010000:2.0:1788636384.190958:0:5794:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.190998:0:5794:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788636384.191000:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818ddf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376704:0@lo:104: 00000100:00100000:2.0:1788636384.191007:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b52c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:1196c107-eaca-4490-96fc-d60d67da8edc+3:11644:x1875520976376832:12345-0@lo:104: Request processed in 56us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636384.191014:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dc700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376832:0@lo:104: 00000100:00100000:2.0:1788636384.191017:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1788636384.191129:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636384.191137:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191146:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe800 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636384.191151:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191161:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636384.191170:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636384.191177:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636384.191209:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191215:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636384.191234:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191254:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe800/0xa6aa59fb12fa7360 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7367 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191266:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636384.191270:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191288:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167ca00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636384.191292:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636384.191294:0:11147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636384.191303:0:11147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191304:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636384.191323:0:11147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffe00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636384.191324:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636384.191331:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:00010000:1.0:1788636384.191335:0:11147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636384.191345:0:11147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191347:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636384.191360:0:11147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191360:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636384.191368:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636384.191370:0:11147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636384.191380:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167ca00/0xa6aa59fb12fa7352 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa7359 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191391:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636384.191394:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636384.191395:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636384.191401:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636384.191405:0:11147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636384.191413:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976376960:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636384.191414:0:11147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636384.191435:0:11147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636384.191442:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffe00/0xa6aa59fb12fa7344 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa734b expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636384.191451:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636384.191462:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636384.191465:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636384.191468:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636384.191480:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976377216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636384.191485:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636384.191494:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976377088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636384.191515:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636384.191541:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976376960 00000100:00100000:0.0:1788636384.191545:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976376960 00010000:00010000:0.0:1788636384.191566:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 19 pid: 5803 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636384.191567:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976377216 00000100:00100000:1.0:1788636384.191573:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976377216 00010000:00010000:1.0:1788636384.191594:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 20 pid: 5804 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636384.191595:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788636384.191606:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+20:3280:x1875520976376960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636384.191617:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636384.191623:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 20 pid: 5803 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636384.191624:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00010000:00010000:0.0:1788636384.191636:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 20 pid: 5803 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636384.191643:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+20:3282:x1875520976377216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636384.191653:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997c200/0xa6aa59fb12fa7367 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7360 expref: 20 pid: 5803 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636384.191654:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636384.191662:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 20 pid: 5804 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.191669:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636384.191673:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 19 pid: 5804 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636384.191685:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd820fdc00/0xa6aa59fb12fa734b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7344 expref: 19 pid: 5804 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636384.191696:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636384.191697:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+18:3280:x1875520976376960:12345-0@lo:103:ldlm_bl.0 Request processed in 92us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636384.191705:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788636384.191745:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+17:3282:x1875520976377216:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636384.191751:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788636384.191779:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636384.191945:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976377088 00000100:00100000:0.0:1788636384.191949:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976377088 00010000:00010000:0.0:1788636384.191964:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 17 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636384.192023:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788636384.192030:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+17:3280:x1875520976377088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636384.192038:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636384.192047:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 17 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.192057:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 17 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.192068:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521ff800/0xa6aa59fb12fa7359 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa7352 expref: 17 pid: 5805 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.192076:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636384.192092:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976376960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636384.192099:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699ab850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+16:3280:x1875520976377088:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636384.192106:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788636384.192122:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976377088:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636384.192152:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81964a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976377216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636384.192952:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636384.192983:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636384.193002:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963761152 00000100:00100000:2.0:1788636384.193008:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963761152 00000100:00100000:0.0:1788636384.193010:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963761024 00000100:00100000:0.0:1788636384.193015:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963761024 00010000:00010000:2.0:1788636384.193034:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 14 pid: 5804 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.193037:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 14 pid: 5803 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636384.193143:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a334a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376320:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636384.193158:0:11644:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11644:1875520976376448:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636384.193171:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00100000:0.0:1788636384.193182:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003dba47-3849-46de-b5b5-7b33358ec353+14:2362:x1875520963761152:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636384.193192:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636384.193193:0:11644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.193199:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 14 pid: 5804 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.193213:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 14 pid: 5804 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.193236:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997d000/0xa6aa59fb12fa736e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554d4 expref: 14 pid: 5804 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636384.193263:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 34 00010000:00010000:0.0:1788636384.193272:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636384.193276:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:003dba47-3849-46de-b5b5-7b33358ec353+13:2362:x1875520963761024:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636384.193285:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636384.193291:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 13 pid: 5803 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193310:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 13 pid: 5803 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193321:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167d000/0xa6aa59fb12fa7375 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351554db expref: 13 pid: 5803 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193333:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193341:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193353:0:6675:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193360:0:6675:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193367:0:6675:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193374:0:6675:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636384.193400:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:003dba47-3849-46de-b5b5-7b33358ec353+12:2362:x1875520963761152:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 220us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636384.193408:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 33 00010000:00010000:2.0:1788636384.193867:0:6675:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636384.193872:0:6675:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.193882:0:6675:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.194016:0:6675:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636384.194028:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636384.194047:0:11644:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636384.194059:0:11644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636384.194068:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:003dba47-3849-46de-b5b5-7b33358ec353+11:2362:x1875520963761024:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 794us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636384.194080:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 34 00010000:00010000:3.0:1788636384.194089:0:11644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74a9 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636384.831509:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636384.895393:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636384.895482:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976377344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636384.895555:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636384.895698:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976377344 00000100:00100000:0.0:1788636384.895706:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976377344 00000100:00100000:0.0:1788636384.895773:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788636384.895782:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976377344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636384.895841:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636384.895884:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d297480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976377344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636384.895892:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788636384.895970:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75970000 x1875520976377344/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788636384.897839:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636384.897917:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976377344:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1788636385.535056:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636385.535063:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613ba800 from 7 10000000:01000000:2.0:1788636385.535068:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636385.535115:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636385.535127:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636385.535140:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636385.535166:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd5d296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976377472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636385.535251:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636385.535322:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd759326c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636385.535549:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976377472 00000100:00100000:0.0:1788636385.535557:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976377472 00000100:00100000:0.0:1788636385.535615:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1788636385.535624:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+16:5808:x1875520976377472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636385.535636:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636385.535649:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa74b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa74b0 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.535673:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa74b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa74b0 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.535683:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa74b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa74b0 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.535702:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031000, rc 0) 00000100:00100000:0.0:1788636385.535755:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976377472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636385.535761:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788636385.535996:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd5d296680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976377472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636385.536011:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636385.536026:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636385.536085:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81964a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976377600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636385.536113:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636385.536144:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942540 going to sleep for 11 seconds 00000100:00100000:3.0:1788636385.536198:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976377600 00000100:00100000:3.0:1788636385.536203:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976377600 00000100:00100000:3.0:1788636385.536245:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788636385.536253:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976377600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636385.536514:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976377600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 262us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.536521:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788636385.536745:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81964a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976377600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636385.536774:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81964a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976377728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636385.536844:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636385.536870:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f942540 going to sleep for 11 seconds 00000100:00100000:3.0:1788636385.536972:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976377728 00000100:00100000:3.0:1788636385.536976:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976377728 00000100:00100000:3.0:1788636385.537007:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788636385.537014:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976377728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636385.537140:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976377728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 126us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.537147:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1788636385.538711:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81964a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976377728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636385.539921:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11658:1875520976377856:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636385.539990:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636385.540033:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636385.540144:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976377856 00000100:00100000:1.0:1788636385.540151:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976377856 00000100:00100000:1.0:1788636385.540194:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1788636385.540213:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:11658:x1875520976377856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636385.540458:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+17:11658:x1875520976377856:12345-0@lo:502:llog_process_th.0 Request processed in 256us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636385.540466:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1788636385.540951:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11658:1875520976377856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636385.540978:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636385.540987:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636385.540989:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788636385.540995:0:11658:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cfd613ba800 00000020:00000080:0.0:1788636385.540997:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788636385.541076:0:11658:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11658:1875520976377984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636385.541116:0:11658:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.541152:0:11658:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636385.541213:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976377984 00000100:00100000:2.0:1788636385.541218:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976377984 00000100:00100000:2.0:1788636385.541261:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788636385.541269:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:11658:x1875520976377984:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636385.541421:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:11658:x1875520976377984:12345-0@lo:502:llog_process_th.0 Request processed in 153us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.541428:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788636385.542923:0:11658:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11658:1875520976377984:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636385.542959:0:11658:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636385.542966:0:11658:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636385.542968:0:11658:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788636385.542972:0:11658:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788636385.543099:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788636385.543115:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636385.543124:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.543134:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636385.543157:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788636385.543160:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd76a12000 from 7 10000000:01000000:0.0:1788636385.543162:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788636385.543188:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.543196:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.543205:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636385.543224:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.543284:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.543311:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636385.543512:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976378112 00000100:00100000:2.0:1788636385.543518:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976378112 00000100:00100000:2.0:1788636385.543552:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788636385.543560:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+17:5808:x1875520976378112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636385.543570:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636385.543641:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa74c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa74be expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636385.543664:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa74c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa74be expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636385.543675:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa74c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa74be expref: 18 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636385.543683:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ff600, rc 0) 00000100:00100000:2.0:1788636385.543720:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976378112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.543726:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1788636385.544846:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636385.544866:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.544877:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636385.544937:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.544976:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.545005:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636385.545113:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976378240 00000100:00100000:2.0:1788636385.545119:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976378240 00000100:00100000:2.0:1788636385.545156:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1788636385.545173:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976378240:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636385.545427:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976378240:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.545434:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:0.0:1788636385.545649:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378240:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.545678:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.545718:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.545741:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4180 going to sleep for 11 seconds 00000100:00100000:3.0:1788636385.546076:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976378368 00000100:00100000:3.0:1788636385.546082:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976378368 00000100:00100000:3.0:1788636385.546119:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788636385.546126:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976378368:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636385.546283:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976378368:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.546295:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1788636385.546435:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378368:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636385.555869:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11659:1875520976378496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636385.555954:0:11659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636385.556067:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fa840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636385.556341:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976378496 00000100:00100000:2.0:1788636385.556349:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976378496 00000100:00100000:2.0:1788636385.556434:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1788636385.556445:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:11659:x1875520976378496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636385.556663:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+18:11659:x1875520976378496:12345-0@lo:502:llog_process_th.0 Request processed in 220us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.556670:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788636385.556746:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11659:1875520976378496:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788636385.556774:0:11659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636385.556784:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636385.556786:0:11659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636385.556812:0:11659:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cfd76a12000 00000020:00000080:3.0:1788636385.556815:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788636385.556886:0:11659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11659:1875520976378624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636385.556922:0:11659:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636385.557139:0:11659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fa840 going to sleep for 11 seconds 00000100:00100000:0.0:1788636385.557533:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976378624 00000100:00100000:0.0:1788636385.557540:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976378624 00000100:00100000:0.0:1788636385.557572:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788636385.557580:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:11659:x1875520976378624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636385.557778:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:11659:x1875520976378624:12345-0@lo:502:llog_process_th.0 Request processed in 198us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636385.557787:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788636385.557944:0:11659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dd500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11659:1875520976378624:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636385.557982:0:11659:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636385.557988:0:11659:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636385.557990:0:11659:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788636385.557994:0:11659:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788636385.558453:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788636385.558472:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636385.558482:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.558492:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636385.558502:0:5808:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788636385.558505:0:5808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd613a5000 from 7 10000000:01000000:0.0:1788636385.558508:0:5808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788636385.558538:0:5808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.558546:0:5808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.558556:0:5808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636385.558585:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.558631:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.558827:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636385.558895:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976378752 00000100:00100000:2.0:1788636385.558901:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976378752 00000100:00100000:2.0:1788636385.558976:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788636385.558985:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+18:5808:x1875520976378752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636385.558996:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636385.559011:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd521fec00/0xa6aa59fb12fa74d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa74cc expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636385.559373:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd521fec00/0xa6aa59fb12fa74d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa74cc expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636385.559398:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd521fec00/0xa6aa59fb12fa74d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa74cc expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636385.559408:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fec00, rc 0) 00000100:00100000:2.0:1788636385.559498:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976378752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 514us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.559506:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788636385.559613:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636385.559630:0:5808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.559639:0:5808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636385.559694:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.559722:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.559787:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636385.559892:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976378880 00000100:00100000:3.0:1788636385.559898:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976378880 00000100:00100000:3.0:1788636385.559962:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1788636385.559972:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976378880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636385.560224:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976378880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 253us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.560231:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788636385.560291:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976378880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.560321:0:5808:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976379008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.560359:0:5808:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.560553:0:5808:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636385.560597:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976379008 00000100:00100000:2.0:1788636385.560603:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976379008 00000100:00100000:2.0:1788636385.560627:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1788636385.560632:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976379008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636385.560833:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:5808:x1875520976379008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.560840:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788636385.560936:0:5808:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:1196c107-eaca-4490-96fc-d60d67da8edc:5808:1875520976379008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.561232:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11662:1875520976379136:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636385.561282:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.561308:0:11662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636385.561351:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976379136 00000100:00100000:3.0:1788636385.561356:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976379136 00000100:00100000:3.0:1788636385.561387:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788636385.561394:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:11662:x1875520976379136:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636385.561539:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:11662:x1875520976379136:12345-0@lo:502:llog_process_th.0 Request processed in 145us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.561553:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788636385.561643:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11662:1875520976379136:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636385.561666:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636385.561681:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636385.561683:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788636385.561689:0:11662:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cfd613a5000 00000020:00000080:0.0:1788636385.561691:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788636385.561768:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11662:1875520976379264:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636385.561860:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636385.561882:0:11662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c46c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636385.562306:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976379264 00000100:00100000:3.0:1788636385.562311:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976379264 00000100:00100000:3.0:1788636385.562344:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788636385.562352:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:11662:x1875520976379264:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636385.562492:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:11662:x1875520976379264:12345-0@lo:502:llog_process_th.0 Request processed in 140us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.562499:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788636385.562523:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:1196c107-eaca-4490-96fc-d60d67da8edc:11662:1875520976379264:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636385.562548:0:11662:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636385.562555:0:11662:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636385.562557:0:11662:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788636385.562560:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788636385.562731:0:5808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1788636385.562752:0:5808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636385.562760:0:5808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.562771:0:5808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636385.563779:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788636385.799369:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636385.799475:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963761280 00000100:00100000:3.0:1788636385.799484:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963761280 00000100:00100000:3.0:1788636385.799532:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 262 00000100:00100000:3.0:1788636385.799540:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+11:5600:x1875520963761280:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636385.799555:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636385.799571:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155528 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636385.799604:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155528 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636385.799616:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155528 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636385.799625:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997de00, rc 0) 00000100:00100000:3.0:1788636385.799679:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963761280:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 Request processed in 139us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.799686:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 262 00000100:00100000:0.0:1788636385.803005:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636385.803096:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963761408 00000100:00100000:2.0:1788636385.803104:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963761408 00000100:00100000:2.0:1788636385.803158:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 263 00000100:00100000:2.0:1788636385.803167:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963761408:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636385.803454:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963761408:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 Request processed in 286us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.803462:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 263 00000100:00100000:1.0:1788636385.813136:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636385.813249:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963761536 00000100:00100000:0.0:1788636385.813259:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963761536 00000100:00100000:0.0:1788636385.813316:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 264 00000100:00100000:0.0:1788636385.813326:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963761536:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636385.813569:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963761536:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 Request processed in 243us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636385.813714:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 264 00000100:00100000:0.0:1788636385.819732:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636385.819882:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963761664 00000100:00100000:3.0:1788636385.819892:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963761664 00000100:00100000:3.0:1788636385.819947:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 265 00000100:00100000:3.0:1788636385.819958:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+12:9967:x1875520963761664:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636385.820210:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+12:9967:x1875520963761664:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 254us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.820219:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 265 00000100:00100000:1.0:1788636385.826096:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636385.826174:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963761792 00000100:00100000:2.0:1788636385.826183:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963761792 00000100:00100000:2.0:1788636385.826242:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 266 00000100:00100000:2.0:1788636385.826252:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:9967:x1875520963761792:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636385.826510:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+12:9967:x1875520963761792:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 259us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.826518:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 266 00000100:00100000:1.0:1788636385.834010:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636385.834106:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963761920 00000100:00100000:0.0:1788636385.834115:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963761920 00000100:00100000:0.0:1788636385.834172:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 267 00000100:00100000:0.0:1788636385.834183:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+12:5600:x1875520963761920:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636385.834221:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636385.834250:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd40030600/0xa6aa59fb12fa74e1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb98284483515552f expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.834278:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd40030600/0xa6aa59fb12fa74e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515552f expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.834290:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd40030600/0xa6aa59fb12fa74e1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515552f expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636385.834299:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40030600, rc 0) 00000100:00100000:0.0:1788636385.834359:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d041c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963761920:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 Request processed in 178us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636385.834366:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 267 00000100:00100000:0.0:1788636385.842445:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636385.842563:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963762048 00000100:00100000:3.0:1788636385.842584:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963762048 00000100:00100000:3.0:1788636385.842632:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 268 00000100:00100000:3.0:1788636385.842640:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963762048:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636385.842962:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963762048:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 Request processed in 320us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.842969:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 268 00000100:00100000:1.0:1788636385.849010:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636385.849087:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963762176 00000100:00100000:2.0:1788636385.849096:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963762176 00000100:00100000:2.0:1788636385.849146:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 269 00000100:00100000:2.0:1788636385.849155:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963762176:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636385.849383:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:5600:x1875520963762176:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 Request processed in 228us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636385.849391:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 269 00010000:00010000:0.0:1788636385.855324:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636385.856000:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636385.864957:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963762304 00000100:00100000:3.0:1788636385.864971:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963762304 00000100:00100000:3.0:1788636385.865094:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 270 00000100:00100000:3.0:1788636385.865104:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:9970:x1875520963762304:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636385.867951:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d042c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:9970:x1875520963762304:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 2837us (11945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.867966:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 270 00000100:00100000:1.0:1788636385.868107:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636385.868257:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636385.868282:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636385.868305:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963762560 00000100:00100000:1.0:1788636385.868311:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963762560 00000100:00100000:1.0:1788636385.868364:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:1.0:1788636385.868373:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963762560:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636385.868421:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963762560:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 50us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636385.868427:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00080000:1.0:1788636385.868444:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636385.868705:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963762432 00000100:00100000:0.0:1788636385.868710:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963762432 00000100:00100000:0.0:1788636385.868751:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963762688 00000100:00100000:0.0:1788636385.868754:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963762688 00000100:00100000:0.0:1788636385.868773:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 98 00000100:00100000:0.0:1788636385.868778:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963762432:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636385.868831:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963762432:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 52us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636385.868837:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 98 00000100:00100000:0.0:1788636385.868851:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 99 00000100:00100000:0.0:1788636385.868857:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963762688:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636385.868892:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963762688:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 35us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636385.868898:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 99 00000100:00080000:1.0:1788636385.875543:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636385.892651:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636385.892740:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963762816 00000100:00100000:3.0:1788636385.892751:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963762816 00000100:00100000:3.0:1788636385.892831:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 271 00000100:00100000:3.0:1788636385.892842:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:9970:x1875520963762816:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636385.893198:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:9970:x1875520963762816:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 355us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636385.893206:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 271 00000040:00080000:3.0:1788636386.623557:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788636386.879051:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636387.903476:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636387.967789:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976379520:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.967881:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636387.967940:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976380032:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.967964:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636387.967991:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788636387.967997:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976379392:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968038:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636387.968060:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976379904:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968081:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636387.968111:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976379520 00000100:00100000:3.0:1788636387.968119:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976379520 00000100:00100000:3.0:1788636387.968159:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976379904 00000100:00100000:3.0:1788636387.968162:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976379904 00000100:00100000:3.0:1788636387.968191:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788636387.968200:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976379520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968257:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976379520:12345-0@lo:400:kworker.0 Request processed in 57us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636387.968265:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788636387.968282:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788636387.968289:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976379904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968317:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976379904:12345-0@lo:400:kworker.0 Request processed in 29us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636387.968338:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788636387.968359:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976379392 00000100:00100000:3.0:1788636387.968363:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976379392 00000100:00100000:3.0:1788636387.968384:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788636387.968390:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976379392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968420:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d043450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976379392:12345-0@lo:400:kworker.0 Request processed in 30us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636387.968426:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00080000:3.0:1788636387.968459:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636387.968485:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976379392:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968497:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976379904:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968505:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976379520:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968529:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976379648:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968552:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636387.968574:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636387.968579:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976379776:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968598:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636387.968621:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976379648 00000100:00100000:3.0:1788636387.968624:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976379648 00000100:00100000:3.0:1788636387.968651:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788636387.968658:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976379648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968687:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976379648:12345-0@lo:400:kworker.0 Request processed in 29us (134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636387.968693:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:3.0:1788636387.968715:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636387.968730:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976379648:0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968770:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976380032 00000100:00100000:3.0:1788636387.968774:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976380032 00000100:00100000:3.0:1788636387.968830:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976379776 00000100:00100000:3.0:1788636387.968833:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976379776 00000100:00100000:3.0:1788636387.968851:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788636387.968857:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875520976380032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968892:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3281:x1875520976380032:12345-0@lo:400:kworker.0 Request processed in 36us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636387.968897:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788636387.968907:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788636387.968912:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976379776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636387.968939:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976379776:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636387.968944:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:3.0:1788636387.968955:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636387.968958:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636387.968971:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976380032:0@lo:400:kworker.0 00010000:00080000:3.0:1788636387.968990:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd818ddc00 x1875520976379776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636387.969001:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976379776:0@lo:400:kworker.0 00000001:00080000:2.0:1788636388.066738:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1788636388.479440:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636388.479464:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976380160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636388.479530:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636388.479684:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976380160 00000100:00100000:0.0:1788636388.479691:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976380160 00000100:00100000:0.0:1788636388.479740:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788636388.479750:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976380160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636388.479783:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636388.479854:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976380160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636388.479861:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788636388.479978:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788636388.479984:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd5d295f80, transno 4294967300 00000100:00100000:2.0:1788636388.480006:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976380160:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788636388.927274:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636389.951236:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636390.016131:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976380288:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636390.016218:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636390.016893:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976380288 00000100:00100000:0.0:1788636390.016903:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976380288 00000100:00100000:0.0:1788636390.016975:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788636390.016987:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976380288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636390.017040:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636390.017114:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976380288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636390.017121:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788636390.017655:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75973b80 x1875520976380288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636390.017688:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976380288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788636390.017771:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788636390.976034:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636390.983917:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636390.983956:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636390.983985:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636390.984037:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636390.984086:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963763200 00000100:00100000:1.0:1788636390.984095:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963763200 00000100:00100000:1.0:1788636390.984162:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:0.0:1788636390.984281:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963763072 00000100:00100000:0.0:1788636390.984293:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963763072 00000100:00100000:0.0:1788636390.984345:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963763328 00000100:00100000:0.0:1788636390.984348:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963763328 00000100:00100000:0.0:1788636390.984370:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 103 00000100:00100000:0.0:1788636390.984395:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963763072:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636390.984471:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963763072:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 78us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636390.984479:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 103 00000100:00100000:0.0:1788636390.984497:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 104 00000100:00100000:0.0:1788636390.984504:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963763328:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636390.984550:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963763328:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 38us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636390.984557:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 104 00000100:00100000:2.0:1788636390.985042:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963762944 00000100:00100000:2.0:1788636390.985047:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963762944 00000100:00100000:2.0:1788636390.985093:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 273 00000100:00100000:2.0:1788636390.985100:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2362:x1875520963762944:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636390.985140:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d040850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2362:x1875520963762944:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 33us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636390.985153:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 273 00000100:00080000:2.0:1788636390.985222:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636390.985233:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636390.986494:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963763200:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636390.986558:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2362:x1875520963763200:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 77us (2521us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636391.010026:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 61 00010000:00010000:1.0:1788636392.001039:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636393.023204:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636393.088487:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976380544:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.088555:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636393.088603:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976381056:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.088640:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636393.088672:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788636393.088678:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976380416:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.088705:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636393.088722:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976380928:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.088742:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636393.088769:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976380672:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.088819:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636393.088839:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636393.088845:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976380800:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.088867:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636393.088906:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976381056 00000100:00100000:3.0:1788636393.088921:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976381056 00000100:00100000:3.0:1788636393.088970:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976380800 00000100:00100000:3.0:1788636393.088973:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976380800 00000100:00100000:3.0:1788636393.088999:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636393.089009:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976381056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089056:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976381056:12345-0@lo:400:kworker.0 Request processed in 48us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636393.089063:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636393.089078:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636393.089084:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976380800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089111:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976380800:12345-0@lo:400:kworker.0 Request processed in 28us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636393.089117:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636393.089132:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976380544 00000100:00100000:3.0:1788636393.089141:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976380544 00000100:00100000:3.0:1788636393.089166:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976380928 00000100:00100000:3.0:1788636393.089169:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976380928 00000100:00100000:3.0:1788636393.089191:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976380672 00000100:00100000:3.0:1788636393.089195:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976380672 00000100:00100000:3.0:1788636393.089210:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788636393.089216:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976380544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089247:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976380544:12345-0@lo:400:kworker.0 Request processed in 31us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636393.089252:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788636393.089263:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788636393.089268:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976380928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089293:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976380928:12345-0@lo:400:kworker.0 Request processed in 24us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636393.089298:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788636393.089308:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788636393.089313:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976380672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089352:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976380672:12345-0@lo:400:kworker.0 Request processed in 39us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636393.089359:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:3.0:1788636393.089375:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636393.089379:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636393.089381:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788636393.089411:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd818dd880 x1875520976380800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636393.089424:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976380800:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089436:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976380672:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089471:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976380928:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089480:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976380544:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.089488:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976381056:0@lo:400:kworker.0 00000100:00100000:0.0:1788636393.090528:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976380416 00000100:00100000:0.0:1788636393.090535:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976380416 00000100:00100000:0.0:1788636393.090570:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788636393.090578:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976380416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636393.090631:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976380416:12345-0@lo:400:kworker.0 Request processed in 55us (1925us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636393.090638:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788636393.096108:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976380416:0@lo:400:kworker.0 00000100:00100000:3.0:1788636393.599174:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976381184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636393.599262:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636393.599412:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976381184 00000100:00100000:0.0:1788636393.599420:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976381184 00000100:00100000:0.0:1788636393.599475:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788636393.599484:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976381184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636393.599517:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636393.599573:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976381184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636393.599580:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636393.599693:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976381184:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636394.054703:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636395.071108:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636395.135207:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636395.135228:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976381312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636395.135307:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636395.135603:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976381312 00000100:00100000:0.0:1788636395.135611:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976381312 00000100:00100000:0.0:1788636395.135682:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788636395.135693:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976381312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636395.135727:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636395.135779:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976381312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636395.135786:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788636395.136045:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636395.136074:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75971c00 x1875520976381312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636395.136102:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976381312:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788636396.095069:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636396.106115:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636396.106155:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636396.106202:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636396.106240:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636396.108619:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963763584 00000100:00100000:2.0:1788636396.108634:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963763584 00000100:00100000:2.0:1788636396.108694:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963763840 00000100:00100000:2.0:1788636396.108698:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963763840 00000100:00100000:2.0:1788636396.108736:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 108 00000100:00100000:2.0:1788636396.108747:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963763584:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636396.108848:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963763584:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 102us (2742us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636396.108856:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 108 00000100:00100000:2.0:1788636396.108874:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 109 00000100:00100000:2.0:1788636396.108880:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963763840:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636396.108905:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963763840:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 26us (2750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636396.108912:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 109 00000100:00100000:3.0:1788636396.109646:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963763712 00000100:00100000:3.0:1788636396.109653:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963763712 00000100:00100000:3.0:1788636396.109703:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00100000:3.0:1788636396.109712:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963763712:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636396.109756:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963763712:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 46us (3515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636396.109763:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00080000:3.0:1788636396.109859:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636396.109864:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636396.115268:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963763456 00000100:00100000:0.0:1788636396.115282:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963763456 00000100:00100000:0.0:1788636396.115359:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 275 00000100:00100000:0.0:1788636396.115370:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963763456:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636396.115460:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963763456:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 92us (9257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636396.115467:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 275 00000040:00080000:2.0:1788636396.863744:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788636397.119218:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636398.144026:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636398.207460:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976381568:0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.207539:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636398.207609:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976382080:0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.207635:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636398.207666:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788636398.207672:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976381440:0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.207699:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636398.207721:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976381952:0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.207754:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636398.207783:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976382080 00000100:00100000:1.0:1788636398.207790:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976382080 00000100:00100000:1.0:1788636398.207861:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788636398.207870:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976382080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.207932:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976382080:12345-0@lo:400:kworker.0 Request processed in 63us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636398.207940:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788636398.207961:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976381440 00000100:00100000:1.0:1788636398.207964:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976381440 00000100:00100000:1.0:1788636398.207983:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788636398.207989:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976381440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.208014:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976381440:12345-0@lo:400:kworker.0 Request processed in 25us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636398.208019:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788636398.208054:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976381440:0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.208065:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976382080:0@lo:400:kworker.0 00000100:00080000:3.0:1788636398.208378:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636398.208397:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976381696:0@lo:400:kworker.0 00000100:00100000:3.0:1788636398.208425:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636398.208455:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636398.208461:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976381824:0@lo:400:kworker.0 00000100:00100000:3.0:1788636398.208492:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636398.208519:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976381824 00000100:00100000:3.0:1788636398.208522:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976381824 00000100:00100000:3.0:1788636398.208553:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788636398.208560:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976381824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636398.208597:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976381824:12345-0@lo:400:kworker.0 Request processed in 38us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636398.208603:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:3.0:1788636398.208617:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788636398.208634:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75973800 x1875520976381824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636398.208645:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976381824:0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.208815:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976381568 00000100:00100000:1.0:1788636398.208820:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976381568 00000100:00100000:1.0:1788636398.208853:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976381952 00000100:00100000:1.0:1788636398.208855:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976381952 00000100:00100000:1.0:1788636398.208870:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976381696 00000100:00100000:1.0:1788636398.208872:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976381696 00000100:00100000:1.0:1788636398.208884:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788636398.208890:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976381568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.208927:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976381568:12345-0@lo:400:kworker.0 Request processed in 37us (1388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636398.208934:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788636398.208946:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788636398.208952:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976381952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.208978:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976381952:12345-0@lo:400:kworker.0 Request processed in 27us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636398.208993:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788636398.209005:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788636398.209011:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976381696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.209043:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976381696:12345-0@lo:400:kworker.0 Request processed in 33us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636398.209049:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788636398.209364:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976381952:0@lo:400:kworker.0 00000100:00100000:1.0:1788636398.209374:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976381568:0@lo:400:kworker.0 00000100:00080000:3.0:1788636398.209440:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636398.209458:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976381696:0@lo:400:kworker.0 00000100:00100000:2.0:1788636398.720938:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976382208:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636398.721016:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636398.721229:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976382208 00000100:00100000:1.0:1788636398.721238:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976382208 00000100:00100000:1.0:1788636398.721322:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788636398.721332:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976382208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636398.721374:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636398.721425:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976382208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636398.721432:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788636398.725398:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976382208:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788636399.169037:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636400.190948:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636400.257845:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976382336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636400.257932:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636400.262208:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976382336 00000100:00100000:0.0:1788636400.262223:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976382336 00000100:00100000:0.0:1788636400.262319:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636400.262332:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976382336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636400.262372:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636400.262452:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976382336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (4518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636400.262459:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1788636400.262552:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636400.263485:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75971500 x1875520976382336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636400.263528:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976382336:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788636401.215055:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636401.226076:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636401.226139:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636401.226255:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963764096 00000100:00100000:1.0:1788636401.226276:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963764096 00000100:00080000:3.0:1788636401.226338:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636401.226369:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 113 00000100:00100000:1.0:1788636401.226380:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963764096:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636401.226467:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963764096:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 88us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636401.226492:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 113 00000100:00100000:0.0:1788636401.226961:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963763968 00000100:00100000:0.0:1788636401.226967:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963763968 00000100:00100000:0.0:1788636401.227015:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 277 00000100:00100000:0.0:1788636401.227024:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963763968:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636401.227069:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963763968:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 47us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636401.227076:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 277 00000100:00100000:2.0:1788636401.239940:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636401.240002:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636401.241634:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963764224 00000100:00100000:1.0:1788636401.241646:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963764224 00000100:00100000:1.0:1788636401.241739:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:1.0:1788636401.241750:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2359:x1875520963764224:12345-192.168.203.57@tcp:9:kworker.0 00000020:00000080:1.0:1788636401.241776:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa741d 00000100:00080000:1.0:1788636401.241785:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9cfd75dc4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788636401.241861:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00080000:3.0:1788636401.241907:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788636401.241937:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636401.242136:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+2:2359:x1875520963764224:12345-192.168.203.57@tcp:9:kworker.0 Request processed in 378us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636401.242145:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:0.0:1788636401.242581:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963764352 00000100:00100000:0.0:1788636401.242587:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963764352 00000100:00100000:0.0:1788636401.242642:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 114 00000100:00100000:0.0:1788636401.242651:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963764352:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636401.242684:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963764352:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 35us (2682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636401.242691:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 114 00000100:00080000:1.0:1788636401.245518:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788636402.239059:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636403.263031:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636403.334431:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636403.334469:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976382464:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.334554:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636403.334656:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976382592:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.334695:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636403.334728:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976382592 00000100:00100000:0.0:1788636403.334736:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976382592 00000100:00100000:0.0:1788636403.334784:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788636403.334793:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976382592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.334860:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976382592:12345-0@lo:400:kworker.0 Request processed in 68us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636403.334867:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788636403.334908:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976382592:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.334962:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976382720:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.334990:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636403.335017:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976382720 00000100:00100000:0.0:1788636403.335021:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976382720 00000100:00100000:0.0:1788636403.335067:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788636403.335075:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976382720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.335107:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976382720:12345-0@lo:400:kworker.0 Request processed in 34us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636403.335126:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:0.0:1788636403.335143:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636403.335173:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976382720:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.335851:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636403.335872:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976382848:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.335903:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636403.335941:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636403.335950:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976382976:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.335973:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636403.335993:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976382976 00000100:00100000:0.0:1788636403.335997:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976382976 00000100:00100000:0.0:1788636403.336025:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788636403.336032:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976382976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.336349:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976382976:12345-0@lo:400:kworker.0 Request processed in 316us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636403.336356:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:0.0:1788636403.336373:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636403.336399:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636403.336853:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976383104:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.336881:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636403.338215:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976382976:0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.344238:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976382464 00000100:00100000:0.0:1788636403.345266:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976382464 00000100:00100000:0.0:1788636403.345329:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788636403.345340:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976382464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636403.345442:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976382464:12345-0@lo:400:kworker.0 Request processed in 104us (10886us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636403.345461:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:2.0:1788636403.351648:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976382848 00000100:00100000:2.0:1788636403.351664:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976382848 00000100:00100000:2.0:1788636403.351759:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976383104 00000100:00100000:2.0:1788636403.351763:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976383104 00000100:00100000:2.0:1788636403.351791:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788636403.351817:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976382848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636403.351910:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976382848:12345-0@lo:400:kworker.0 Request processed in 97us (16005us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636403.351930:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788636403.351948:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788636403.351955:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976383104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636403.351994:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976383104:12345-0@lo:400:kworker.0 Request processed in 39us (15112us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636403.352000:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1788636403.352019:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636403.352023:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788636403.352074:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75973100 x1875520976382848/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636403.352091:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976382848:0@lo:400:kworker.0 00000100:00100000:2.0:1788636403.352135:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976383104:0@lo:400:kworker.0 00000100:00100000:3.0:1788636403.356512:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976382464:0@lo:400:kworker.0 00000001:00100000:1.0:1788636403.448461:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:1.0:1788636403.448471:0:7625:0:(genops.c:885:class_export_put()) final put ffff9cfd75dc7800/38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:0.0:1788636403.448611:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd75dc7800/38630149-ece4-4de3-88b1-a62e16a39489 for lustre-OST0001 00000020:00000080:0.0:1788636403.448662:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd75dc4000 for lustre-OST0001 00000100:00100000:3.0:1788636403.839144:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636403.839181:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976383232:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636403.839263:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636403.839966:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976383232 00000100:00100000:0.0:1788636403.839974:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976383232 00000100:00100000:0.0:1788636403.840029:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788636403.840040:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976383232:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636403.840075:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636403.840142:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976383232:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636403.840150:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788636403.840587:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976383232:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788636404.289101:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636405.311355:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636405.375516:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976383360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636405.375596:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636405.375669:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976383360 00000100:00100000:0.0:1788636405.375676:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976383360 00000100:00100000:0.0:1788636405.375728:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788636405.375737:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976383360:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788636405.375773:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788636405.375773:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636405.375896:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976383360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 160us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636405.375911:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788636405.375954:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75973480 x1875520976383360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636421 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636405.375972:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976383360:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788636406.085245:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788636406.334951:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636406.345468:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636406.345569:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636406.345639:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963764608 00000100:00100000:2.0:1788636406.345648:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963764608 00000100:00100000:2.0:1788636406.345713:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 118 00000100:00100000:2.0:1788636406.345723:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963764608:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636406.345830:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963764608:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 73us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636406.345838:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 118 00000100:00080000:0.0:1788636406.345992:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636406.346344:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963764480 00000100:00100000:1.0:1788636406.346349:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963764480 00000100:00100000:1.0:1788636406.346417:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 279 00000100:00100000:1.0:1788636406.346425:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963764480:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636406.347451:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963764480:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 1023us (1986us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636406.347460:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 279 00000100:00100000:3.0:1788636406.348084:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636406.348129:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963764736 00000100:00100000:0.0:1788636406.348136:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963764736 00000100:00100000:0.0:1788636406.348206:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 119 00000100:00100000:0.0:1788636406.348215:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2363:x1875520963764736:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636406.348281:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2363:x1875520963764736:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 68us (199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636406.348288:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 119 00000100:00080000:1.0:1788636406.348344:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788636407.359495:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636408.384575:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788636408.401197:0:11834:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 15:26:47 (1788636407) 00000100:00100000:1.0:1788636408.449072:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976383488:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449156:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636408.449198:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976384000:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449224:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636408.449251:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788636408.449257:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976383616:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449279:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636408.449296:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976384128:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449318:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636408.449347:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976383744:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449381:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636408.449402:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636408.449408:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976383872:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449429:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636408.449459:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976383488 00000100:00100000:1.0:1788636408.449466:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976383488 00000100:00100000:1.0:1788636408.449509:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788636408.449518:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976383488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449566:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976383488:12345-0@lo:400:kworker.0 Request processed in 49us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636408.449573:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:1.0:1788636408.449604:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976384000 00000100:00100000:1.0:1788636408.449608:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976384000 00000100:00100000:1.0:1788636408.449637:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976383616 00000100:00100000:1.0:1788636408.449640:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976383616 00000100:00100000:1.0:1788636408.449652:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976383744 00000100:00100000:1.0:1788636408.449654:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976383744 00000100:00100000:1.0:1788636408.449669:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788636408.449682:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976384000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449715:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976384000:12345-0@lo:400:kworker.0 Request processed in 34us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636408.449721:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788636408.449733:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788636408.449738:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976383616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449764:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976383616:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636408.449770:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788636408.449781:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788636408.449787:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976383744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449838:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976383744:12345-0@lo:400:kworker.0 Request processed in 50us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636408.449844:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788636408.449866:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976384128 00000100:00100000:1.0:1788636408.449869:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976384128 00000100:00100000:1.0:1788636408.449893:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976383872 00000100:00100000:1.0:1788636408.449895:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976383872 00000100:00100000:1.0:1788636408.449914:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788636408.449920:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976384128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449950:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976384128:12345-0@lo:400:kworker.0 Request processed in 31us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636408.449956:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788636408.449966:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788636408.449971:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976383872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.449995:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976383872:12345-0@lo:400:kworker.0 Request processed in 24us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636408.450007:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788636408.450032:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788636408.450036:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636408.450038:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788636408.450072:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd7a1b1c00 x1875520976383872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636408.450096:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976383872:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.450112:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976383744:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.450137:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976383616:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.450147:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976384128:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.450154:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976383488:0@lo:400:kworker.0 00000100:00100000:1.0:1788636408.450162:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976384000:0@lo:400:kworker.0 00000100:00100000:0.0:1788636408.961493:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636408.961514:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976384256:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636408.961579:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636408.961891:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976384256 00000100:00100000:3.0:1788636408.961899:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976384256 00000100:00100000:3.0:1788636408.961954:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788636408.961962:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976384256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636408.961993:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636408.962040:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976384256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (460us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636408.962047:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788636408.962143:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976384256:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788636409.407244:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636410.431609:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636410.495625:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636410.495647:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976384384:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636410.495718:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636410.495857:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976384384 00000100:00100000:3.0:1788636410.495865:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976384384 00000100:00100000:3.0:1788636410.495928:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788636410.495938:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976384384:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636410.495972:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636410.496020:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976384384:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636410.496026:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1788636410.496089:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788636410.496119:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75973100 x1875520976384384/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636426 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636410.496137:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976384384:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636410.862394:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636410.862534:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963764864 00000100:00100000:1.0:1788636410.862544:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963764864 00000100:00100000:1.0:1788636410.862629:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 32 00000100:00100000:1.0:1788636410.862652:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:10240:x1875520963764864:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636410.862672:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636410.862693:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa74e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155536 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.862756:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa74ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.862770:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa74ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.862784:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa74ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636410.862858:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788636410.862863:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636410.862899:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa74ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.862934:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa74e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155536 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.862952:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa74ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155536 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.862962:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:1.0:1788636410.862965:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636410.862968:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196b600, rc 0) 00000100:00100000:1.0:1788636410.863024:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:10240:x1875520963764864:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 374us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636410.863052:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 32 00000100:00080000:2.0:1788636410.865481:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636410.884598:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636410.884825:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963764992 00000100:00100000:1.0:1788636410.884836:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963764992 00000100:00100000:1.0:1788636410.884898:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00100000:1.0:1788636410.884909:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:10241:x1875520963764992:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636410.884931:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636410.884950:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa74f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515553d expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885015:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885030:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885053:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885076:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885085:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885092:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885432:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a600/0xa6aa59fb12fa750b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885451:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a600/0xa6aa59fb12fa750b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885458:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a600/0xa6aa59fb12fa750b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636410.885487:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788636410.885491:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636410.885509:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a600/0xa6aa59fb12fa750b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885518:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885524:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885530:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885535:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ae00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636410.885539:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885546:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885558:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:1.0:1788636410.885561:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636410.885565:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885650:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa74fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885666:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885673:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885678:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885683:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196bc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636410.885686:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885692:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885700:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cfd5a43c600) 00010000:00010000:1.0:1788636410.885702:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636410.885705:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885710:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7504 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885743:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa74f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515553d expref: 8 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885756:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a600/0xa6aa59fb12fa750b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515553d expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.885769:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:1.0:1788636410.885771:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636410.885773:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a600, rc 0) 00000100:00100000:1.0:1788636410.886300:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:10241:x1875520963764992:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 1390us (1720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636410.886309:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00100000:3.0:1788636410.913766:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636410.913914:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963765248 00000100:00100000:1.0:1788636410.913923:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963765248 00000100:00100000:1.0:1788636410.913968:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:1.0:1788636410.913978:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:10241:x1875520963765248:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636410.913998:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636410.914018:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7512 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155544 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914099:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914114:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914124:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914191:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914208:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914224:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914544:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa7527 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914552:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa7527 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914558:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa7527 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636410.914567:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788636410.914684:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914692:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914697:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914702:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196bc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636410.914705:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914712:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914722:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:1.0:1788636410.914724:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636410.914733:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914739:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7519 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914749:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914754:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914758:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914762:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ae00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636410.914765:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914769:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914774:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cfd5a43c600) 00010000:00010000:1.0:1788636410.914776:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636410.914778:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.914783:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7520 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.915580:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7512 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155544 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.915609:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa7527 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155544 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636410.915618:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:1.0:1788636410.915620:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636410.915623:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196b800, rc 0) 00000100:00100000:1.0:1788636410.915689:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+9:10241:x1875520963765248:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 1711us (1930us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788636410.915698:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:0.0:1788636410.938111:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636410.938355:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963765376 00000100:00100000:1.0:1788636410.938364:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963765376 00000100:00100000:1.0:1788636410.938435:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 35 00000100:00100000:1.0:1788636410.938446:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:10241:x1875520963765376:12345-192.168.203.57@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788636410.938551:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:10241:x1875520963765376:12345-192.168.203.57@tcp:59:lhsmtool_posix.0 Request processed in 107us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636410.938559:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 35 00000040:00080000:2.0:1788636411.199770:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788636411.456913:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636411.470233:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636411.470288:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636411.470376:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963765504 00000100:00100000:1.0:1788636411.470389:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963765504 00000100:00100000:1.0:1788636411.470468:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 281 00000100:00100000:1.0:1788636411.470480:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2362:x1875520963765504:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636411.470573:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2362:x1875520963765504:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 95us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636411.470582:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 281 00000100:00100000:3.0:1788636411.472656:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963765632 00000100:00100000:3.0:1788636411.472672:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963765632 00000100:00100000:3.0:1788636411.472819:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 123 00000100:00100000:3.0:1788636411.472830:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963765632:12345-192.168.203.57@tcp:400:kworker.0 00000100:00080000:2.0:1788636411.473305:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636411.473585:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963765632:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 753us (3292us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636411.473594:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 123 00010000:00010000:1.0:1788636412.480015:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636413.501292:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636413.501629:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963765760 00000100:00100000:0.0:1788636413.501643:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963765760 00000100:00100000:0.0:1788636413.501775:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:0.0:1788636413.501790:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:10283:x1875520963765760:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636413.501846:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636413.501887:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7535 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515554b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.501982:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502000:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502016:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502062:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502072:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502079:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502319:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502329:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502337:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502342:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40030e00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636413.502347:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502366:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502382:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:0.0:1788636413.502386:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636413.502391:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502400:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40030e00/0xa6aa59fb12fa753c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.502660:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503283:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503292:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503298:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191da00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636413.503302:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503311:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503323:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cfd500eb000) 00010000:00010000:0.0:1788636413.503326:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636413.503330:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503348:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7543 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503396:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7535 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515554b expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503408:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:0.0:1788636413.503411:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636413.503415:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd40031e00/0xa6aa59fb12fa7535 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515554b expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.503987:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd40031e00, rc 0) 00000100:00100000:0.0:1788636413.504623:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:10283:x1875520963765760:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 2833us (3341us total) trans 0 rc 301/301 00000100:00100000:0.0:1788636413.504632:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 36 00010000:00010000:3.0:1788636413.504835:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788636413.505006:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636413.512520:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636413.512606:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963766016 00000100:00100000:1.0:1788636413.512619:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963766016 00000100:00100000:1.0:1788636413.512719:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:1.0:1788636413.512748:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+9:10283:x1875520963766016:12345-192.168.203.57@tcp:36:lfs.0 00010000:00010000:1.0:1788636413.512846:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636413.512881:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa74ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155536 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.513181:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:1.0:1788636413.513197:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636413.513569:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.513586:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.513600:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.513615:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.513622:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.513629:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636413.517269:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788636413.517294:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.517320:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.517329:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.517337:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636413.517343:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.517353:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.517373:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd5a43cb00) 00010000:00010000:1.0:1788636413.517376:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636413.517383:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.517390:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa754a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636413.517414:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000881a849 reply state 0000000081d34082 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636413.517988:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636413.521548:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+10:10283:x1875520963766016:12345-192.168.203.57@tcp:36:lfs.0 Request processed in 5421us (5642us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788636413.521563:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 37 00010000:00010000:1.0:1788636413.522256:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.522285:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.522294:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.522301:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636413.522307:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.522316:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.522335:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cfd5a43cd00) 00010000:00010000:1.0:1788636413.522339:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636413.522345:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.522352:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7551 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636413.588365:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976384512:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.588468:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636413.588523:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976385024:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.588553:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636413.588590:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788636413.588595:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976384640:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.588619:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636413.588653:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976385152:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.588680:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636413.588711:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976384768:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.588735:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636413.588756:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636413.588761:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976384896:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.588784:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636413.589121:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976384512 00000100:00100000:1.0:1788636413.589133:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976384512 00000100:00100000:1.0:1788636413.589187:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788636413.589198:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976384512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589261:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976384512:12345-0@lo:400:kworker.0 Request processed in 65us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636413.589269:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:1.0:1788636413.589308:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976385024 00000100:00100000:1.0:1788636413.589312:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976385024 00000100:00100000:1.0:1788636413.589347:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976384640 00000100:00100000:1.0:1788636413.589350:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976384640 00000100:00100000:1.0:1788636413.589362:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976384768 00000100:00100000:1.0:1788636413.589364:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976384768 00000100:00100000:1.0:1788636413.589380:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788636413.589386:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976385024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589419:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976385024:12345-0@lo:400:kworker.0 Request processed in 34us (865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636413.589425:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788636413.589437:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788636413.589443:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976384640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589487:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976384640:12345-0@lo:400:kworker.0 Request processed in 44us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636413.589492:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788636413.589505:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788636413.589510:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976384768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589540:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976384768:12345-0@lo:400:kworker.0 Request processed in 30us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636413.589546:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788636413.589566:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976385152 00000100:00100000:1.0:1788636413.589569:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976385152 00000100:00100000:1.0:1788636413.589594:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976384896 00000100:00100000:1.0:1788636413.589596:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976384896 00000100:00100000:1.0:1788636413.589615:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788636413.589621:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976385152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589652:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976385152:12345-0@lo:400:kworker.0 Request processed in 31us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636413.589658:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788636413.589668:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636413.589673:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976384896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589698:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976384896:12345-0@lo:400:kworker.0 Request processed in 25us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636413.589704:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788636413.589821:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976384640:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589834:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976385152:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589843:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976384512:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589863:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976385024:0@lo:400:kworker.0 00010000:00080000:1.0:1788636413.589906:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd75ba3800 x1875520976384896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788636429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636413.589918:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976384896:0@lo:400:kworker.0 00000100:00100000:1.0:1788636413.589928:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976384768:0@lo:400:kworker.0 00000100:00080000:3.0:1788636413.601258:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636413.601269:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636413.601273:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636413.629168:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636413.629228:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963766144 00000100:00100000:3.0:1788636413.629244:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963766144 00000100:00100000:3.0:1788636413.629316:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:3.0:1788636413.629328:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:10291:x1875520963766144:12345-192.168.203.57@tcp:101:lctl.0 00010000:00010000:3.0:1788636413.629360:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636413.629389:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7558 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155552 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.629475:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa755f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.629493:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa755f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.629507:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa755f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636413.629565:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788636413.629570:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636413.629614:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa755f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.629642:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7558 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155552 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.629666:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa755f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155552 expref: 10 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.629675:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636413.629679:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636413.629683:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d000, rc 0) 00000100:00100000:3.0:1788636413.629758:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75867800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+10:10291:x1875520963766144:12345-192.168.203.57@tcp:101:lctl.0 Request processed in 432us (610us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636413.629766:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 38 00000001:00080000:2.0:1788636413.667000:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000100:00100000:2.0:1788636413.693756:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636413.693913:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963766272 00000100:00100000:0.0:1788636413.693926:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963766272 00000100:00100000:0.0:1788636413.694002:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:0.0:1788636413.694013:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:10297:x1875520963766272:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636413.694039:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636413.694077:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7566 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155559 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694172:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694191:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694225:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694244:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694252:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694259:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694624:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c000/0xa6aa59fb12fa757b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694635:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c000/0xa6aa59fb12fa757b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694643:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c000/0xa6aa59fb12fa757b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636413.694677:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788636413.694681:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636413.694729:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c000/0xa6aa59fb12fa757b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694744:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694752:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694771:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694779:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636413.694784:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694856:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694873:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636413.694877:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636413.694882:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694890:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa756d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694904:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694912:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694919:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694925:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636413.694928:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694945:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694954:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cfd500eb300) 00010000:00010000:0.0:1788636413.694957:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636413.694960:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.694967:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7574 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.695001:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7566 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155559 expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.695016:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c000/0xa6aa59fb12fa757b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155559 expref: 9 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.695025:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:0.0:1788636413.695027:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788636413.695030:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c000, rc 0) 00000100:00100000:0.0:1788636413.695115:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+9:10297:x1875520963766272:12345-192.168.203.57@tcp:101:bash.0 Request processed in 1102us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636413.695124:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:3.0:1788636413.699344:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636413.699621:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963766528 00000100:00100000:1.0:1788636413.699636:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963766528 00000100:00100000:1.0:1788636413.699752:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:1.0:1788636413.699765:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:10297:x1875520963766528:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636413.699792:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636413.699860:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa7582 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155560 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.700422:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.700442:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.700455:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.702600:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.702626:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.702663:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788636413.705276:0:5810:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788636413.706915:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.706938:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.706952:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.707545:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.707556:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.708126:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.708137:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636413.708142:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.708150:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.708165:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636413.708230:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636413.708249:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.708256:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7589 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636413.708273:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000572e1040 reply state 00000000ebb0ef4f transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636413.708281:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788636413.708331:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa7582 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 12 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.708351:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 11 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.708360:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd5a43cb00) 00010000:00010000:1.0:1788636413.708362:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636413.708365:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ba00, rc 0) 00000100:00100000:1.0:1788636413.708446:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75865c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+12:10297:x1875520963766528:12345-192.168.203.57@tcp:101:bash.0 Request processed in 8684us (9117us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788636413.708456:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:1.0:1788636413.713134:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636413.713214:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963766656 00000100:00100000:2.0:1788636413.713227:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963766656 00000100:00100000:2.0:1788636413.713285:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:2.0:1788636413.713295:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2359:x1875520963766656:12345-192.168.203.57@tcp:8:bash.0 00010000:00080000:2.0:1788636413.713334:0:6659:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp t0 exp 0000000000000000 cur 282 last 0 00000020:00000080:2.0:1788636413.713375:0:6659:0:(genops.c:1385:class_connect()) connect: client 38630149-ece4-4de3-88b1-a62e16a39489, cookie 0xa6aa59fb12fa75a5 00002000:00100000:2.0:1788636413.713404:0:6659:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 38630149-ece4-4de3-88b1-a62e16a39489/ffff9cfd75bc4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788636413.713435:0:6659:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788636413.713713:0:6659:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788636413.713752:0:6659:0:(import.c:65:import_set_state_nolock()) ffff9cfd75bc2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636413.713871:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2359:x1875520963766656:12345-192.168.203.57@tcp:8:bash.0 Request processed in 575us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636413.713881:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 20 00010000:00010000:3.0:1788636413.715621:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.715640:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.715648:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.715655:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636413.715679:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.715690:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.715711:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd5a43cd00) 00010000:00010000:3.0:1788636413.715715:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636413.715722:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.715730:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7590 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636413.716349:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636413.716446:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963766784 00000100:00100000:1.0:1788636413.716458:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963766784 00000100:00100000:0.0:1788636413.716620:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:0.0:1788636413.716631:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:0:x1875520963766784:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636413.716649:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636413.716682:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155567 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788636413.716714:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788636413.716739:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=282s v=(0 0) 00010000:00010000:0.0:1788636413.716744:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636413.716754:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.716776:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.716792:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c400, rc 0) 00000100:00100000:0.0:1788636413.716890:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:0:x1875520963766784:12345-192.168.203.57@tcp:101:bash.0 Request processed in 260us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636413.716905:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00080000:3.0:1788636413.720199:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636413.722758:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636413.722929:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963766912 00000100:00100000:2.0:1788636413.722942:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963766912 00000100:00100000:2.0:1788636413.723067:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:2.0:1788636413.723079:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:10297:x1875520963766912:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:2.0:1788636413.723103:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636413.723128:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515556e expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.723178:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.723188:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636413.723193:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636413.723199:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.723244:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.723285:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 8 pid: 6661 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636413.723303:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1875520976385280:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636413.723428:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47efa540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636413.726298:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636413.726434:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1875520976385280:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636413.726476:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636413.726525:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ffe00, rc 0) 00000100:00100000:1.0:1788636413.726602:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:10297:x1875520963766912:12345-192.168.203.57@tcp:101:bash.0 Request processed in 3525us (3858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636413.726612:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:0.0:1788636413.727996:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963767040 00000100:00100000:0.0:1788636413.728012:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963767040 00010000:00010000:0.0:1788636413.728077:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 8 pid: 6661 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636413.728185:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 35 00000100:00100000:0.0:1788636413.728197:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963767040:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636413.728215:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636413.728245:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 8 pid: 6661 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.728277:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 8 pid: 6661 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.728307:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa75ac lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155567 expref: 8 pid: 6661 timeout: 382 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.728326:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636413.728332:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636413.728343:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.728354:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636413.728401:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636413.728418:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5797:1875520976385408:192.168.203.57@tcp:105: 00000100:00100000:0.0:1788636413.728524:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788636413.735582:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636413.735721:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963767296 00000100:00100000:3.0:1788636413.735734:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963767296 00000100:00100000:3.0:1788636413.735822:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:3.0:1788636413.735835:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+11:10297:x1875520963767296:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:3.0:1788636413.736317:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+12:10297:x1875520963767296:12345-192.168.203.57@tcp:35:bash.0 Request processed in 481us (747us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788636413.736326:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:2.0:1788636413.741275:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5797:1875520976385408:192.168.203.57@tcp:105: 00010000:00010000:2.0:1788636413.741315:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636413.741458:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963767040:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 13261us (15170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636413.741471:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 35 00000100:00100000:0.0:1788636413.856387:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636413.856516:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963767552 00000100:00100000:3.0:1788636413.856530:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963767552 00000100:00100000:3.0:1788636413.856615:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 41 00000100:00100000:3.0:1788636413.856627:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+12:10307:x1875520963767552:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636413.856660:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636413.856689:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa75ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155575 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636413.856882:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788636413.857280:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa75ba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155575 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.857298:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636413.857301:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636413.857307:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa75ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155575 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.857329:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d600, rc 0) 00000100:00100000:2.0:1788636413.857408:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+13:10307:x1875520963767552:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 783us (1038us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788636413.857417:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 41 00000100:00100000:1.0:1788636413.860141:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636413.860407:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963767808 00000100:00100000:3.0:1788636413.860420:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963767808 00000100:00100000:3.0:1788636413.860492:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:3.0:1788636413.860504:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+13:10307:x1875520963767808:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636413.861157:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+14:10307:x1875520963767808:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 642us (1015us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788636413.861168:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:1.0:1788636413.988604:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636413.988715:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963767936 00000100:00100000:3.0:1788636413.988729:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963767936 00000100:00100000:3.0:1788636413.988894:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:3.0:1788636413.988909:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+14:10313:x1875520963767936:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636413.988944:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636413.988980:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa75c8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515557c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.989088:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa75cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.989105:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa75cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.989119:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa75cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636413.989167:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788636413.989171:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636413.989220:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa75cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.989255:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa75c8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515557c expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.989281:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa75cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515557c expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636413.989293:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:3.0:1788636413.989296:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636413.989302:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636413.989379:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+15:10313:x1875520963767936:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 474us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636413.989387:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:1.0:1788636413.993537:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636413.993632:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963768192 00000100:00100000:2.0:1788636413.993658:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963768192 00000100:00100000:2.0:1788636413.994282:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 43 00000100:00100000:2.0:1788636413.994298:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+15:10313:x1875520963768192:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636413.994326:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636413.994354:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe200/0xa6aa59fb12fa75d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155583 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.994488:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe800/0xa6aa59fb12fa75dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.994506:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe800/0xa6aa59fb12fa75dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.994521:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe800/0xa6aa59fb12fa75dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636413.994534:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788636413.994691:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe200/0xa6aa59fb12fa75d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155583 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.994714:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe800/0xa6aa59fb12fa75dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155583 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636413.995215:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd5a43cb00) 00010000:00010000:2.0:1788636413.995220:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636413.995226:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe800, rc 0) 00000100:00100000:2.0:1788636413.995318:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+17:10313:x1875520963768192:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1023us (1789us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788636413.995327:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 43 00000100:00100000:1.0:1788636413.998716:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636414.000620:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963768448 00000100:00100000:3.0:1788636414.000637:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963768448 00000100:00100000:3.0:1788636414.000720:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:3.0:1788636414.000742:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+17:10313:x1875520963768448:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636414.000771:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636414.000979:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa75eb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515558a expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.001121:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa75f2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.001140:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa75f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.001255:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa75f2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636414.001273:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788636414.001432:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa75eb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515558a expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.001458:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa75f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515558a expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.001468:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd5a43cb00) 00010000:00010000:3.0:1788636414.001472:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788636414.001477:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997ca00, rc 0) 00000100:00100000:3.0:1788636414.001818:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:10313:x1875520963768448:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1078us (3113us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788636414.001828:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:2.0:1788636414.002986:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636414.003090:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963768576 00000100:00100000:3.0:1788636414.003100:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963768576 00000100:00100000:3.0:1788636414.003245:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:3.0:1788636414.003259:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+19:2363:x1875520963768576:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636414.003274:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636414.003299:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe800/0xa6aa59fb12fa75dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155583 expref: 19 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.003318:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd5a43cb00) 00010000:00010000:3.0:1788636414.003323:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636414.003391:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+18:2363:x1875520963768576:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 135us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636414.003400:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:1.0:1788636414.009755:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.010218:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963768704 00000100:00100000:0.0:1788636414.010232:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963768704 00000100:00100000:0.0:1788636414.010302:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:0.0:1788636414.010313:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963768704:12345-192.168.203.57@tcp:1:lfs.0 00010000:00010000:0.0:1788636414.010389:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.010415:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.010424:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788636414.010429:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636414.010435:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.010481:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.010498:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 7 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636414.010516:0:6661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1875520976385536:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636414.010640:0:6661:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c99c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636414.012864:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636414.012961:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963768832 00000100:00100000:1.0:1788636414.012971:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963768832 00002000:00100000:1.0:1788636414.013029:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9cfd6a334380 x1875520963768832/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:655/0 lens 504/0 e 0 to 0 dl 1788636425 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636414.013051:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6a334380 with x1875520963768832 ext(0->12) 00010000:00010000:1.0:1788636414.013063:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 8 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.013083:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 8 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636414.013092:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cfd6a334380 00000100:00100000:1.0:1788636414.013257:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:1.0:1788636414.013269:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963768832:12345-192.168.203.57@tcp:4:lfs.0 00000100:00100000:0.0:1788636414.014918:0:6661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1875520976385536:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636414.015023:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636414.079527:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976385664:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636414.079606:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636414.079872:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976385664 00000100:00100000:1.0:1788636414.079956:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976385664 00000100:00100000:1.0:1788636414.080012:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788636414.080022:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976385664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636414.080067:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636414.080128:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976385664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636414.080135:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788636414.080356:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976385664:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788636414.083869:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000100:00100000:1.0:1788636414.085686:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2362:x1875520963768832:12345-192.168.203.57@tcp:4:lfs.0 Request processed in 72410us (72825us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788636414.085699:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00002000:00100000:1.0:1788636414.085712:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9cfd6a334380 x1875520963768832/t4294967299(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:655/0 lens 504/448 e 0 to 0 dl 1788636425 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788636414.085723:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6a334380 with x1875520963768832 ext(0->12) 00010000:00010000:1.0:1788636414.085734:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 9 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.085936:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 9 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636414.085947:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cfd6a334380 00000100:00100000:2.0:1788636414.090616:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636414.090698:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963768960 00000100:00100000:3.0:1788636414.090708:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963768960 00010000:00010000:3.0:1788636414.090746:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 9 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636414.090980:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:3.0:1788636414.090992:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2360:x1875520963768960:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636414.091009:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788636414.091029:0:5795:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788636414.091032:0:5795:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788636414 00002000:00010000:3.0:1788636414.091035:0:5795:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788636414 00002000:00010000:3.0:1788636414.091037:0:5795:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788636414 00010000:00010000:3.0:1788636414.091052:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 9 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.091066:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 9 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.091093:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa75b3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515556e expref: 9 pid: 6659 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.091122:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636414.091127:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636414.091372:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.091385:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.091418:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636414.091632:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.091655:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.091684:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.091692:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.091700:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.091707:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c400 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636414.091711:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.091720:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.091733:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.091740:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ee30367/0xa6aa59fb12fa7600 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636414.092094:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2360:x1875520963768960:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 1102us (1482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636414.099862:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:1.0:1788636414.110345:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963768704:12345-192.168.203.57@tcp:1:lfs.0 Request processed in 97483us (98053us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636414.110368:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:2.0:1788636414.114413:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.115525:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963769216 00000100:00100000:0.0:1788636414.115603:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963769216 00000100:00100000:0.0:1788636414.115692:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:0.0:1788636414.115704:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+18:10313:x1875520963769216:12345-192.168.203.57@tcp:35:lfs.0 00000004:00010000:0.0:1788636414.115781:0:5813:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa75f2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515558a expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636414.116350:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788636414.116419:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788636414.119401:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788636414.119742:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.120035:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 22 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.120057:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.120099:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 22 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.120611:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 22 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636414.120629:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5813:1875520976385792:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636414.122319:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7faf1540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636414.128004:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636414.128142:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963769344 00000100:00100000:3.0:1788636414.128160:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963769344 00010000:00010000:3.0:1788636414.128197:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 23 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636414.128307:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:3.0:1788636414.128318:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+23:2362:x1875520963769344:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636414.128332:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636414.128339:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 23 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.128352:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 23 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.128383:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd5a43cb00) 00010000:00010000:3.0:1788636414.128389:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.128415:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.128422:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.128441:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636414.128493:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+23:2362:x1875520963769344:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 177us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636414.128500:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 37 00010000:00010000:0.0:1788636414.128684:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7597 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155560 expref: 22 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636414.128701:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5813:1875520976385792:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636414.128721:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.128730:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.128736:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636414.128909:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788636414.129108:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1788636414.129239:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5813:1875520976385920:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788636414.129297:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636414.129328:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7faf1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636414.131058:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976385920 00000100:00100000:0.0:1788636414.131074:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976385920 00000100:00100000:1.0:1788636414.132343:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636414.132358:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1875520976385920:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788636414.132513:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1875520976385920:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 159us (3214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636414.132520:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636414.132684:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5813:1875520976385920:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788636414.135343:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1788636414.136678:0:5813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a283480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5813:1875520976386048:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788636414.136746:0:5813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636414.137419:0:5813:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47efa540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636414.139463:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976386048 00000100:00100000:2.0:1788636414.139474:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976386048 00000100:00100000:2.0:1788636414.139546:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636414.139555:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5813:x1875520976386048:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788636414.139840:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5813:x1875520976386048:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 286us (3092us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788636414.139848:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636414.140337:0:5813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a283480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5813:1875520976386048:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1788636414.140425:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1788636414.140474:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.140485:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.140493:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.140512:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636414.140516:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.140525:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.140551:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd5a43cb00) 00010000:00010000:0.0:1788636414.140555:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788636414.140560:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.140566:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7607 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636414.140750:0:5813:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788636414.141051:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1788636414.141063:0:5813:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 283165266692ns, next at 284165264403ns, rc = 0 00000001:00080000:0.0:1788636414.141073:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1788636414.141108:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd5a43cb00) 00010000:00010000:0.0:1788636414.141111:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788636414.141119:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa75f2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515558a expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636414.142020:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+25:10313:x1875520963769216:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 26313us (27608us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788636414.142031:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00000020:00080000:0.0:1788636414.142036:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788636414.148007:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.148092:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963769472 00000100:00100000:0.0:1788636414.148101:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963769472 00000100:00100000:0.0:1788636414.148163:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:0.0:1788636414.148173:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+25:10313:x1875520963769472:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636414.148196:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636414.148344:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa760e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155591 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.148414:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa760e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155591 expref: 26 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.148531:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa760e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155591 expref: 26 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.148619:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:0.0:1788636414.148622:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636414.148626:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d800, rc 0) 00000100:00100000:0.0:1788636414.148681:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+26:10313:x1875520963769472:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 509us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636414.148688:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:2.0:1788636414.155837:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636414.156103:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963769728 00000100:00100000:3.0:1788636414.156295:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963769728 00000100:00100000:3.0:1788636414.156391:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:3.0:1788636414.156402:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd4841bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+26:10313:x1875520963769728:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636414.156635:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd4841bc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+27:10313:x1875520963769728:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 234us (844us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788636414.156642:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:3.0:1788636414.210248:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.210328:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963769984 00000100:00100000:0.0:1788636414.210342:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963769984 00000100:00100000:0.0:1788636414.210490:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:0.0:1788636414.210502:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+27:10324:x1875520963769984:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636414.210523:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636414.210605:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7615 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155598 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636414.210706:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788636414.216320:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7615 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155598 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.216342:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636414.216345:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636414.216351:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7615 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155598 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.216364:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c400, rc 0) 00000100:00100000:0.0:1788636414.216441:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75867480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+28:10324:x1875520963769984:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 5940us (6297us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1788636414.216449:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:2.0:1788636414.226688:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.228083:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963770112 00000100:00100000:0.0:1788636414.228100:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963770112 00000100:00100000:0.0:1788636414.228179:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 47 00000100:00100000:0.0:1788636414.228190:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+28:10324:x1875520963770112:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:0.0:1788636414.228282:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228301:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228312:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228324:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228346:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228351:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228473:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228483:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228491:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636414.228551:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228566:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228573:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228579:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228586:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636414.228590:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228599:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228621:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:0.0:1788636414.228625:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636414.228631:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228639:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7623 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228655:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228663:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228669:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228674:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191dc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636414.228677:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228682:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228707:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd500ebd00) 00010000:00010000:0.0:1788636414.228709:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636414.228712:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228717:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa762a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228746:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228753:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228759:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228766:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191ce00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636414.228771:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228776:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228783:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:0.0:1788636414.228786:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636414.228788:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.228838:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7631 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636414.229387:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+28:10324:x1875520963770112:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 1192us (2709us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636414.229400:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 47 00000100:00100000:1.0:1788636414.232590:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.233529:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963770368 00000100:00100000:0.0:1788636414.233538:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963770368 00000100:00100000:0.0:1788636414.233613:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:0.0:1788636414.233624:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+28:10324:x1875520963770368:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:0.0:1788636414.233940:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+29:10324:x1875520963770368:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 318us (1359us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788636414.233956:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:3.0:1788636414.272611:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636414.272744:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963770624 00000100:00100000:1.0:1788636414.272753:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963770624 00000100:00100000:1.0:1788636414.272834:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00100000:1.0:1788636414.272845:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+29:10327:x1875520963770624:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636414.272869:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636414.272889:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7638 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515559f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.272973:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.272988:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273000:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273015:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273023:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273029:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273161:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273170:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273178:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636414.273189:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788636414.273285:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273293:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273300:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273306:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636414.273310:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273318:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273329:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636414.273344:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636414.273349:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273366:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa763f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273379:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273384:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273390:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273394:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636414.273397:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273403:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273411:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd5a43c300) 00010000:00010000:1.0:1788636414.273414:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636414.273417:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273423:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7646 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273464:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7638 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273478:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 31 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.273493:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:1.0:1788636414.273495:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636414.273498:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a000, rc 0) 00000100:00100000:1.0:1788636414.273665:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75864380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+31:10327:x1875520963770624:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 707us (948us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1788636414.273674:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00100000:2.0:1788636414.276459:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636414.276671:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963770752 00000100:00100000:1.0:1788636414.276680:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963770752 00000100:00100000:1.0:1788636414.276731:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:1.0:1788636414.276741:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+31:10327:x1875520963770752:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:1.0:1788636414.276819:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276834:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276846:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276870:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276877:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276885:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276890:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636414.276906:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276914:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276926:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:1.0:1788636414.276929:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636414.276934:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.276940:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa765b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636414.277462:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+31:10327:x1875520963770752:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 719us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636414.277471:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:2.0:1788636414.286716:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.287355:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963771008 00000100:00100000:0.0:1788636414.287365:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963771008 00000100:00100000:0.0:1788636414.287424:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:0.0:1788636414.287435:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+31:10327:x1875520963771008:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:0.0:1788636414.287779:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+32:10327:x1875520963771008:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 344us (1071us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788636414.287787:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:3.0:1788636414.480614:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636414.480851:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963771264 00000100:00100000:1.0:1788636414.480861:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963771264 00000100:00100000:1.0:1788636414.480922:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:1.0:1788636414.480932:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+32:10358:x1875520963771264:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:1.0:1788636414.480960:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636414.480981:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa7662 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555a6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.481094:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7669 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.481110:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.481138:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7669 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636414.481161:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788636414.481300:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa7662 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555a6 expref: 35 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.481318:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7669 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555a6 expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.481326:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:1.0:1788636414.481330:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636414.481333:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ac00, rc 0) 00000100:00100000:1.0:1788636414.481404:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75867100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+34:10358:x1875520963771264:12345-192.168.203.57@tcp:101:cat.0 Request processed in 474us (799us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788636414.481412:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:2.0:1788636414.486004:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.486124:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963771520 00000100:00100000:0.0:1788636414.486134:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963771520 00000100:00100000:0.0:1788636414.486194:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:0.0:1788636414.486204:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+34:10358:x1875520963771520:12345-192.168.203.57@tcp:35:cat.0 00000100:00100000:0.0:1788636414.486472:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+35:10358:x1875520963771520:12345-192.168.203.57@tcp:35:cat.0 Request processed in 269us (477us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788636414.486481:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:2.0:1788636414.492132:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.492314:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963771648 00000100:00100000:0.0:1788636414.492323:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963771648 00000100:00100000:0.0:1788636414.492409:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:0.0:1788636414.492420:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+35:2361:x1875520963771648:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636414.492435:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636414.492659:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7669 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555a6 expref: 35 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636414.492679:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:0.0:1788636414.492684:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636414.492750:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699ab050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+34:2361:x1875520963771648:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 332us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636414.492759:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 3 00010000:00010000:2.0:1788636414.527013:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636414.545604:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636414.557328:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963771904 00000100:00100000:1.0:1788636414.557342:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963771904 00000100:00100000:1.0:1788636414.557418:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 51 00000100:00100000:1.0:1788636414.557428:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+34:10364:x1875520963771904:12345-192.168.203.57@tcp:101:dd.0 00010000:00010000:1.0:1788636414.557456:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636414.557460:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788636414.557486:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa75cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515557c expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.557511:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636414.557516:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636414.557546:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa7677 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555ad expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.557639:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.557653:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.557662:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.557696:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.557711:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 34 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636414.557723:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75ba2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976386176:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636414.557852:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e5be40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636414.565705:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636414.565867:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75ba2680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976386176:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636414.565911:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636414.566424:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963772032 00000100:00100000:3.0:1788636414.566435:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963772032 00010000:00010000:3.0:1788636414.566485:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 35 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636414.566578:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:3.0:1788636414.566590:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+35:2362:x1875520963772032:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636414.566629:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636414.566637:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 35 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.566653:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 35 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.566682:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa764d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515559f expref: 35 pid: 5810 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.566701:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:3.0:1788636414.566707:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.566719:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.566729:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.566766:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636414.566884:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+34:2362:x1875520963772032:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 296us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636414.566893:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 38 00010000:00010000:2.0:1788636414.567507:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.567518:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636414.567546:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788636414.567826:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa7677 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 35 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.567847:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.567856:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:2.0:1788636414.567859:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636414.567863:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196b400, rc 0) 00000100:00100000:2.0:1788636414.567906:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+34:10364:x1875520963771904:12345-192.168.203.57@tcp:101:dd.0 Request processed in 10480us (22313us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788636414.567914:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 51 00000100:00100000:2.0:1788636414.578749:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636414.578920:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963772288 00000100:00100000:1.0:1788636414.578934:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963772288 00000100:00100000:1.0:1788636414.579010:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 52 00000100:00100000:1.0:1788636414.579023:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+34:10364:x1875520963772288:12345-192.168.203.57@tcp:36:dd.0 00010000:00010000:1.0:1788636414.579919:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.579958:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636414.579973:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636414.580029:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788636414.580069:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000052601053 reply state 000000003be6ac7b transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636414.580079:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636414.580204:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+37:10364:x1875520963772288:12345-192.168.203.57@tcp:36:dd.0 Request processed in 1180us (1467us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788636414.580213:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 52 00000020:00080000:1.0:1788636414.580219:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788636414.584328:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.584349:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.584381:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.584389:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636414.584395:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.584404:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.584426:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:3.0:1788636414.584430:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636414.584436:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.584443:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa768c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636414.957983:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636414.958192:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963772416 00000100:00100000:3.0:1788636414.958206:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963772416 00000100:00100000:3.0:1788636414.958284:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 53 00000100:00100000:3.0:1788636414.958296:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+36:10378:x1875520963772416:12345-192.168.203.57@tcp:101:stat.0 00010000:00010000:3.0:1788636414.958328:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636414.958368:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7693 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555b4 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958462:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958491:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958526:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958545:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958552:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958559:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958667:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958679:0:7975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958688:0:7975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958743:0:7975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.958759:0:7975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 37 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636414.958776:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75864a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976386304:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636414.958987:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c63c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636414.963945:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636414.964195:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963772672 00000100:00100000:0.0:1788636414.964208:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963772672 00000100:00100000:0.0:1788636414.964288:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:0.0:1788636414.964300:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+38:5597:x1875520963772672:12345-192.168.203.57@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788636414.966312:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+39:5597:x1875520963772672:12345-192.168.203.57@tcp:35:ldlm_bl.0 Request processed in 2001us (2369us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788636414.966324:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:3.0:1788636414.968780:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75864a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976386304:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636414.968837:0:7975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636414.969219:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636414.969452:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963772800 00000100:00100000:3.0:1788636414.969460:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963772800 00010000:00010000:3.0:1788636414.969504:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 39 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636414.969546:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:3.0:1788636414.969556:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+39:2361:x1875520963772800:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636414.969573:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636414.969580:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 39 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.969594:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 39 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.969620:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa767e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555ad expref: 39 pid: 5812 timeout: 383 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.969638:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:3.0:1788636414.969644:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.969654:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.969663:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636414.969712:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636414.969779:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+38:2361:x1875520963772800:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 223us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636414.969787:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 39 00010000:00010000:2.0:1788636414.969903:0:7975:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.969912:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636414.969973:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788636414.969978:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636414.970022:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970047:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970058:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970065:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970072:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970078:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636414.970083:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970092:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970104:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636414.970107:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636414.970110:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970117:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa769a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970153:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970160:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970165:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970170:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636414.970174:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970180:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970188:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd42a85600) 00010000:00010000:2.0:1788636414.970191:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636414.970194:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970199:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa76a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970240:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7693 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555b4 expref: 38 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970255:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555b4 expref: 37 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636414.970274:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:2.0:1788636414.970276:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636414.970279:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d600, rc 0) 00000100:00100000:2.0:1788636414.970308:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+37:10378:x1875520963772416:12345-192.168.203.57@tcp:101:stat.0 Request processed in 12015us (12343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636414.970315:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 53 00000100:00100000:2.0:1788636415.063275:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636415.063384:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963773056 00000100:00100000:1.0:1788636415.063397:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963773056 00000100:00100000:1.0:1788636415.063479:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00100000:1.0:1788636415.063491:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+37:10384:x1875520963773056:12345-192.168.203.57@tcp:36:truncate.0 00010000:00010000:1.0:1788636415.063578:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636415.063611:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555b4 expref: 37 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.063634:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:1.0:1788636415.063639:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636415.063952:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.064220:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.064234:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636415.064297:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1788636415.064326:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005e157c3 reply state 0000000060f9a12b transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636415.064335:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636415.064601:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+39:10384:x1875520963773056:12345-192.168.203.57@tcp:36:truncate.0 Request processed in 1108us (1335us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1788636415.064610:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 54 00000020:00080000:1.0:1788636415.064615:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1788636415.064837:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636415.068471:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.068492:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.068500:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.068507:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636415.068512:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.068522:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.068544:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:2.0:1788636415.068547:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636415.068552:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.068558:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa76af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636415.192368:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636415.193202:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963773184 00000100:00100000:0.0:1788636415.193217:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963773184 00000100:00100000:0.0:1788636415.193350:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 55 00000100:00100000:0.0:1788636415.193363:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+38:10398:x1875520963773184:12345-192.168.203.57@tcp:101:stat.0 00010000:00010000:0.0:1788636415.193394:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636415.193423:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa76b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555bb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193506:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193523:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193538:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193580:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193588:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193596:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193709:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193718:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193740:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636415.193784:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788636415.193789:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636415.193837:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193851:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193860:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.193867:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194023:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194030:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636415.194043:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194053:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194068:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:0.0:1788636415.194072:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636415.194077:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194084:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa76bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194101:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194305:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194312:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194317:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636415.194321:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194341:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194351:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd500ebd00) 00010000:00010000:0.0:1788636415.194354:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636415.194357:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194364:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa76c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194405:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa76b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 40 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194421:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.194429:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:0.0:1788636415.194432:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636415.194434:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191ca00, rc 0) 00000100:00100000:0.0:1788636415.194535:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+39:10398:x1875520963773184:12345-192.168.203.57@tcp:101:stat.0 Request processed in 1174us (2180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636415.194544:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 55 00000100:00100000:1.0:1788636415.262534:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636415.262648:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963773440 00000100:00100000:3.0:1788636415.262662:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963773440 00000100:00100000:3.0:1788636415.262741:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 56 00000100:00100000:3.0:1788636415.262753:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+39:10408:x1875520963773440:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636415.262782:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636415.262852:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555c2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636415.263091:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788636415.263269:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555c2 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.263287:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636415.263292:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636415.263298:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555c2 expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.263318:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d600, rc 0) 00000100:00100000:3.0:1788636415.263546:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+40:10408:x1875520963773440:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 794us (1026us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1788636415.263556:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 56 00000100:00100000:3.0:1788636415.267111:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636415.267240:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963773696 00000100:00100000:2.0:1788636415.267254:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963773696 00000100:00100000:2.0:1788636415.267332:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:2.0:1788636415.267345:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+40:10408:x1875520963773696:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636415.267739:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+41:10408:x1875520963773696:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 394us (639us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1788636415.267748:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:2.0:1788636415.314316:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636415.314398:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963773952 00000100:00100000:3.0:1788636415.314412:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963773952 00000100:00100000:3.0:1788636415.314488:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 57 00000100:00100000:3.0:1788636415.314497:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+41:10414:x1875520963773952:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:3.0:1788636415.314525:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636415.314547:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76e0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555c9 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.314660:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.314675:0:7975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.314681:0:7975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.314714:0:7975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.314725:0:7975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 42 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636415.314742:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75865180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976386432:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636415.314991:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636415.318401:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636415.318566:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75865180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976386432:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636415.318609:0:7975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636415.319633:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963774080 00000100:00100000:0.0:1788636415.319646:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963774080 00010000:00010000:0.0:1788636415.319698:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 43 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636415.320369:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:0.0:1788636415.320383:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+43:2363:x1875520963774080:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636415.320401:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636415.320411:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 43 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.320427:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 43 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.320456:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa76cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555bb expref: 43 pid: 5812 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.320477:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:0.0:1788636415.320483:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.320493:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.320502:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.320542:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636415.320624:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+42:2363:x1875520963774080:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 245us (2237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636415.320632:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 40 00010000:00010000:2.0:1788636415.320765:0:7975:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.320774:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636415.320820:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1788636415.321094:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa76e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 43 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.321117:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 42 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.321125:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:2.0:1788636415.321127:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636415.321130:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c400, rc 0) 00000100:00100000:2.0:1788636415.321774:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+42:10414:x1875520963773952:12345-192.168.203.57@tcp:101:bash.0 Request processed in 7273us (7469us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1788636415.321835:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 57 00000100:00100000:1.0:1788636415.324688:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636415.324784:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963774336 00000100:00100000:3.0:1788636415.324837:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963774336 00000100:00100000:3.0:1788636415.325089:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:3.0:1788636415.325101:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+42:10414:x1875520963774336:12345-192.168.203.57@tcp:36:bash.0 00010000:00010000:3.0:1788636415.325566:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.325588:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.325602:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636415.325658:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1788636415.325683:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000003663a3c reply state 000000003e14dd9b transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636415.325693:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636415.326210:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+45:10414:x1875520963774336:12345-192.168.203.57@tcp:36:bash.0 Request processed in 1105us (1531us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1788636415.326219:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 58 00000020:00080000:3.0:1788636415.326227:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788636415.338777:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636415.339005:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963774464 00000100:00100000:0.0:1788636415.339048:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963774464 00010000:00010000:3.0:1788636415.339194:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.339208:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.339217:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.339232:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636415.339238:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.339247:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.339267:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:3.0:1788636415.339270:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636415.339276:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.339282:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa76f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636415.341068:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00100000:1.0:1788636415.341101:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+44:10414:x1875520963774464:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636415.341133:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636415.341160:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa76fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555d0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.341392:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.341409:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 45 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.341426:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.341468:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 45 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.341484:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 45 pid: 7975 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636415.341500:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75bd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976386560:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636415.341616:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e5be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636415.344600:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636415.344937:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963774592 00000100:00100000:0.0:1788636415.344947:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963774592 00010000:00010000:0.0:1788636415.344999:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 46 pid: 7975 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636415.345049:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 41 00000100:00100000:0.0:1788636415.345061:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75865180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+46:2362:x1875520963774592:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636415.345080:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636415.345087:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 46 pid: 7975 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.345112:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 46 pid: 7975 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.345148:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:0.0:1788636415.345154:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.345166:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.345174:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.345198:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636415.345260:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75865180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+46:2362:x1875520963774592:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 201us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636415.345268:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 41 00010000:00010000:1.0:1788636415.345668:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa76e7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555c9 expref: 45 pid: 7975 timeout: 384 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636415.345692:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75bd4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976386560:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636415.345723:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.345745:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.345751:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636415.345834:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788636415.345840:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636415.345865:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.345921:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa76fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555d0 expref: 45 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.345937:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555d0 expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.345946:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:1.0:1788636415.345950:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636415.345953:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196aa00, rc 0) 00000100:00100000:1.0:1788636415.346058:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+44:10414:x1875520963774464:12345-192.168.203.57@tcp:101:bash.0 Request processed in 4975us (7295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636415.346066:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00100000:0.0:1788636415.349635:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636415.349731:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963774848 00000100:00100000:2.0:1788636415.349744:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963774848 00000100:00100000:2.0:1788636415.349825:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:2.0:1788636415.349837:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd4841a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+44:10414:x1875520963774848:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:2.0:1788636415.350270:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd4841a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+45:10414:x1875520963774848:12345-192.168.203.57@tcp:35:bash.0 Request processed in 434us (646us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1788636415.350277:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:2.0:1788636415.402224:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636415.402503:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963775104 00000100:00100000:0.0:1788636415.402517:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963775104 00000100:00100000:0.0:1788636415.402595:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 60 00000100:00100000:0.0:1788636415.402608:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+45:10424:x1875520963775104:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636415.402641:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636415.402669:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa770a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555d7 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636415.402791:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788636415.403282:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa770a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555d7 expref: 47 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.403300:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636415.403304:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636415.403310:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa770a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555d7 expref: 47 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.403327:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191dc00, rc 0) 00000100:00100000:0.0:1788636415.406739:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+46:10424:x1875520963775104:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 4114us (4509us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1788636415.406756:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 60 00000100:00100000:3.0:1788636415.417015:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636415.417518:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963775232 00000100:00100000:2.0:1788636415.417531:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963775232 00000100:00100000:2.0:1788636415.417602:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:2.0:1788636415.417613:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+46:10424:x1875520963775232:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:2.0:1788636415.417707:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.417737:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.417751:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.417767:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.417775:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.417846:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.417959:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.417967:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.417975:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636415.418022:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418045:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418052:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418060:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418066:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636415.418071:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418080:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418093:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636415.418117:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636415.418124:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418132:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7718 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418153:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418159:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418165:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418170:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eaa00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636415.418173:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418179:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418186:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd62575000) 00010000:00010000:2.0:1788636415.418188:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636415.418190:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418195:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa771f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418211:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418221:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418227:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418232:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eae00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636415.418234:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418240:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418247:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:2.0:1788636415.418249:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636415.418252:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.418257:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7726 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636415.418346:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75866d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+46:10424:x1875520963775232:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 733us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636415.418354:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:2.0:1788636415.431052:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636415.431721:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963775488 00000100:00100000:3.0:1788636415.431748:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963775488 00000100:00100000:3.0:1788636415.431859:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:3.0:1788636415.431871:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+46:10424:x1875520963775488:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636415.432230:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+47:10424:x1875520963775488:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 360us (1203us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1788636415.432239:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:3.0:1788636415.473970:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636415.474399:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963775744 00000100:00100000:1.0:1788636415.474412:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963775744 00000100:00100000:1.0:1788636415.474497:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 62 00000100:00100000:1.0:1788636415.474510:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+47:10427:x1875520963775744:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636415.474547:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636415.474576:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa772d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555de expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.474680:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.474698:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.474712:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475003:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475013:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475021:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475322:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7742 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475333:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475342:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7742 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636415.475356:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788636415.475498:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475507:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475515:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475522:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196bc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636415.475528:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475551:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475567:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636415.475570:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636415.475577:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475584:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7734 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475601:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475607:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475613:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475618:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636415.475621:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475627:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475634:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd5a43c300) 00010000:00010000:1.0:1788636415.475637:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636415.475640:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475656:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa773b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.475715:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa772d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555de expref: 50 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.477014:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7742 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555de expref: 49 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.477066:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:1.0:1788636415.477070:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636415.477074:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a200, rc 0) 00000100:00100000:1.0:1788636415.477202:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75866a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+49:10427:x1875520963775744:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 2693us (3246us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788636415.477213:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 62 00000100:00100000:3.0:1788636415.481189:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636415.481240:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636415.481408:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963776000 00000100:00100000:1.0:1788636415.481421:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963776000 00000100:00100000:1.0:1788636415.481491:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:1.0:1788636415.481502:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75866300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+49:2361:x1875520963776000:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636415.481521:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636415.481554:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7742 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555de expref: 49 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636415.481579:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:1.0:1788636415.481585:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636415.481651:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75866300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+48:2361:x1875520963776000:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 150us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636415.481678:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:2.0:1788636415.482246:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963775872 00000100:00100000:2.0:1788636415.482254:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963775872 00000100:00100000:2.0:1788636415.482310:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:2.0:1788636415.482321:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+48:10427:x1875520963775872:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:2.0:1788636415.482410:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482428:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482441:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482475:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482483:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482490:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482496:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eaa00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636415.482502:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482511:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482521:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:2.0:1788636415.482524:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636415.482528:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.482535:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7750 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636415.482611:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75866680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+48:10427:x1875520963775872:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 294us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636415.482619:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:3.0:1788636415.484903:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636415.485288:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963776256 00000100:00100000:2.0:1788636415.485299:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963776256 00000100:00100000:2.0:1788636415.485499:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:2.0:1788636415.485510:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+48:10427:x1875520963776256:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636415.485856:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+49:10427:x1875520963776256:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 346us (968us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1788636415.485866:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 17 00010000:00010000:1.0:1788636415.551084:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636415.598210:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636415.598331:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963776512 00000100:00100000:3.0:1788636415.598345:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963776512 00000100:00100000:3.0:1788636415.598426:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00100000:3.0:1788636415.598438:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+49:10445:x1875520963776512:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:3.0:1788636415.598479:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636415.598506:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7757 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555e5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.598639:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa775e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.598658:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa775e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.598673:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa775e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636415.598686:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788636415.598884:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7757 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555e5 expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.598907:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa775e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555e5 expref: 51 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636415.598917:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:3.0:1788636415.598920:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788636415.598924:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997ca00, rc 0) 00000100:00100000:3.0:1788636415.599006:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+51:10445:x1875520963776512:12345-192.168.203.57@tcp:101:cat.0 Request processed in 571us (810us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788636415.599049:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00100000:2.0:1788636415.615842:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000004:00080000:0.0:1788636415.615857:0:6962:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 284640059949ns, next at 285640056399ns, rc = 0 00000100:00100000:2.0:1788636415.615875:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976386688:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636415.615971:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636415.619900:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976386688 00000100:00100000:1.0:1788636415.619921:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976386688 00000100:00100000:1.0:1788636415.620048:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788636415.620064:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976386688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636415.620116:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788636415.620214:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636415.620234:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976386688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 177us (4263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636415.620242:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788636415.620312:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976386688:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636415.623112:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636415.623842:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963776640 00000100:00100000:0.0:1788636415.623855:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963776640 00000100:00100000:0.0:1788636415.623933:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 65 00000100:00100000:0.0:1788636415.623945:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+51:10446:x1875520963776640:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636415.623993:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636415.624019:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa776c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555ec expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.624119:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7773 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.624135:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.624148:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636415.624201:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788636415.624206:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636415.624226:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7773 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.624257:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa776c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555ec expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.624278:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7773 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555ec expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.624287:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:0.0:1788636415.624290:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636415.624293:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191de00, rc 0) 00000100:00100000:0.0:1788636415.624381:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+52:10446:x1875520963776640:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 433us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636415.624395:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 65 00000100:00100000:0.0:1788636415.638670:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636415.640678:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963777024 00000100:00100000:2.0:1788636415.640697:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963777024 00000100:00100000:2.0:1788636415.640786:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:2.0:1788636415.640829:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+52:10446:x1875520963777024:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636415.642200:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+53:10446:x1875520963777024:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 1394us (3534us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1788636415.642213:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:2.0:1788636415.646659:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636415.647928:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963777152 00000100:00100000:0.0:1788636415.647946:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963777152 00000100:00100000:0.0:1788636415.648108:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:0.0:1788636415.648122:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+53:10446:x1875520963777152:12345-192.168.203.57@tcp:103:lfs.0 00010000:00010000:0.0:1788636415.648143:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788636415.648177:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7703 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555d0 expref: 53 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.648205:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa775e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555e5 expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.648221:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa760e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155591 expref: 51 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636415.648232:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:0.0:1788636415.648246:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636415.648437:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+50:10446:x1875520963777152:12345-192.168.203.57@tcp:103:lfs.0 Request processed in 317us (1890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636415.648446:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:1.0:1788636415.651460:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636415.655247:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963777280 00000100:00100000:3.0:1788636415.655343:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963777280 00000100:00100000:2.0:1788636415.660178:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 66 00000100:00100000:2.0:1788636415.660198:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+50:10446:x1875520963777280:12345-192.168.203.57@tcp:58:lfs.0 00010000:00010000:2.0:1788636415.660369:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.660389:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.660402:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636415.660770:0:5811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636415.662315:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1788636415.662417:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1788636415.662587:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+50:10446:x1875520963777280:12345-192.168.203.57@tcp:58:lfs.0 Request processed in 2388us (11135us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636415.662600:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 66 00000100:00100000:3.0:1788636415.688180:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636415.688356:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963777408 00000100:00100000:2.0:1788636415.688368:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963777408 00000100:00100000:2.0:1788636415.688446:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 67 00000100:00100000:2.0:1788636415.688458:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+50:10448:x1875520963777408:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636415.688483:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636415.688511:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7781 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555f3 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.688595:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.688613:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.688627:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.688662:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.688671:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.688678:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690088:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690212:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690225:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636415.690351:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788636415.690356:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636415.690382:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690397:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690407:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690414:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690441:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690448:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636415.690452:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690462:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690477:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636415.690480:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636415.690485:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690491:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7788 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690508:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690514:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690520:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690525:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636415.690527:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690547:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690556:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd62575400) 00010000:00010000:2.0:1788636415.690558:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636415.690562:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690568:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa778f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690613:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7781 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 52 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690628:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 51 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636415.690635:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636415.690638:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636415.690640:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea200, rc 0) 00000100:00100000:2.0:1788636415.691389:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75864e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+51:10448:x1875520963777408:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 2927us (3216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636415.691400:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 67 00000040:00080000:3.0:1788636416.325997:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636416.326005:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636416.326058:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1788636416.326065:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636416.326179:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75864700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976386816:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788636416.326277:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd450c6cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636416.336172:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75864700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976386816:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636416.346406:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.346500:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963777536 00000100:00100000:3.0:1788636416.346512:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963777536 00000100:00100000:3.0:1788636416.346726:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:3.0:1788636416.346738:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:38630149-ece4-4de3-88b1-a62e16a39489+51:10459:x1875520963777536:12345-192.168.203.57@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788636416.346837:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:38630149-ece4-4de3-88b1-a62e16a39489+51:10459:x1875520963777536:12345-192.168.203.57@tcp:900:lhsmtool_posix.0 Request processed in 101us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.346846:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:0.0:1788636416.354960:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636416.362998:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963777664 00000100:00100000:1.0:1788636416.363012:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963777664 00000100:00100000:3.0:1788636416.363539:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 68 00000100:00100000:3.0:1788636416.363551:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+51:10459:x1875520963777664:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788636416.363582:0:5810:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788636416.363695:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+51:10459:x1875520963777664:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 146us (8743us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.363703:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 68 00000100:00100000:3.0:1788636416.378364:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636416.383286:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963777792 00000100:00100000:0.0:1788636416.383301:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963777792 00000100:00100000:0.0:1788636416.383368:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:0.0:1788636416.383378:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+51:10459:x1875520963777792:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788636416.383449:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383482:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383497:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383514:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383521:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383528:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383555:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383572:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383580:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636416.383617:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788636416.383623:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636416.383639:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383650:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383666:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383672:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383677:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636416.383681:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383689:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383702:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:0.0:1788636416.383705:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636416.383711:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383717:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa779d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383728:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383735:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383740:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383745:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636416.383753:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383771:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383779:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9cfd500eb300) 00010000:00010000:0.0:1788636416.383782:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636416.383784:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383790:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d400/0xa6aa59fb12fa77a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383828:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383835:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383841:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383847:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191cc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636416.383850:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383856:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383865:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:0.0:1788636416.383868:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636416.383877:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.383884:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa77ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636416.383964:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75864700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+51:10459:x1875520963777792:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 Request processed in 586us (5609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636416.383972:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:2.0:1788636416.391152:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.391193:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963778048 00000100:00100000:3.0:1788636416.391204:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963778048 00000100:00100000:3.0:1788636416.391266:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 70 00000100:00100000:3.0:1788636416.391277:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+51:10459:x1875520963778048:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.391295:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636416.391317:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351555fa expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391417:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391433:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391446:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636416.391457:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788636416.391547:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391555:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391562:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391569:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636416.391573:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391592:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391605:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:3.0:1788636416.391608:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636416.391613:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391620:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391665:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555fa expref: 53 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391676:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:3.0:1788636416.391679:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636416.391683:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555fa expref: 53 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.391693:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636416.391749:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+52:10459:x1875520963778048:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 474us (605us total) trans 4294967351 rc 301/301 00000040:00080000:1.0:1788636416.399202:0:11984:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636416.399212:0:11984:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636416.399254:0:11984:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788636416.399261:0:11984:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636416.399367:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 70 00000100:00100000:3.0:1788636416.399473:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.399504:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963778176 00000100:00100000:3.0:1788636416.400748:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963778176 00000100:00100000:3.0:1788636416.400818:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 71 00000100:00100000:3.0:1788636416.400828:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+52:10459:x1875520963778176:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788636416.400865:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788636416.401857:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75864000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+52:10459:x1875520963778176:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 1025us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.401867:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 71 00000100:00100000:2.0:1788636416.423867:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636416.423903:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963778432 00000100:00100000:2.0:1788636416.423912:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963778432 00000100:00100000:2.0:1788636416.423963:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 72 00000100:00100000:2.0:1788636416.423982:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+52:10459:x1875520963778432:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636416.424004:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636416.424007:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788636416.424044:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7773 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555ec expref: 52 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.424063:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636416.424069:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636416.424083:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa77c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155601 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636416.424504:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1788636416.424914:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa77ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.424928:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa77ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.424938:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa77ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.424995:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa77c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155601 expref: 54 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.425010:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa77ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155601 expref: 53 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.425018:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd62575400) 00010000:00010000:2.0:1788636416.425021:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636416.425042:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb200, rc 0) 00000100:00100000:2.0:1788636416.425106:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+53:10459:x1875520963778432:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 1124us (1245us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1788636416.425114:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 72 00000100:00100000:2.0:1788636416.435737:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.436078:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963778688 00000100:00100000:3.0:1788636416.436089:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963778688 00000100:00100000:3.0:1788636416.436155:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 73 00000100:00100000:3.0:1788636416.436166:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+53:10459:x1875520963778688:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.436219:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636416.436246:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa77ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155601 expref: 53 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436263:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd62575400) 00010000:00010000:3.0:1788636416.436274:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636416.436296:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436309:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436319:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436371:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436378:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436401:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436464:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436471:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436478:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436483:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636416.436488:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436495:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436503:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:3.0:1788636416.436505:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636416.436509:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436515:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa77dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436525:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436531:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436544:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436549:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636416.436552:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436559:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436567:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xa72064b0 (ffff9cfd42a85500) 00010000:00010000:3.0:1788636416.436569:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636416.436572:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.436577:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa77e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xa72064b0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636416.436656:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+52:10459:x1875520963778688:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 492us (928us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636416.436663:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 73 00000100:00100000:2.0:1788636416.455047:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.456569:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963778816 00000100:00100000:3.0:1788636416.456582:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963778816 00000100:00100000:3.0:1788636416.456675:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 74 00000100:00100000:3.0:1788636416.456686:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+52:10459:x1875520963778816:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.456705:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636416.456728:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155608 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.456778:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.456792:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.456818:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.456904:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 54 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.456925:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 53 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.456935:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:3.0:1788636416.456937:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636416.456940:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d600, rc 0) 00000100:00100000:3.0:1788636416.456997:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+53:10459:x1875520963778816:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 313us (1957us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.457004:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 74 00000100:00100000:0.0:1788636416.480786:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.480888:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963779072 00000100:00100000:3.0:1788636416.480898:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963779072 00000100:00100000:3.0:1788636416.480962:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 75 00000100:00100000:3.0:1788636416.480973:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+53:10459:x1875520963779072:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.481066:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.481096:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.481110:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636416.481409:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1788636416.481419:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 285505622727ns, next at 286505619902ns, rc = 0 00000004:00010000:3.0:1788636416.481501:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009c2c2f07 reply state 00000000ffcd309a transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636416.481510:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636416.481700:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+55:10459:x1875520963779072:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 728us (922us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1788636416.481707:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 75 00010000:00010000:1.0:1788636416.483502:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.483518:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.483525:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.483530:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636416.483535:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.483550:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.483622:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:1.0:1788636416.483626:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788636416.483631:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.483637:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa77f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636416.485791:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636416.485897:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963779200 00000100:00100000:1.0:1788636416.485907:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963779200 00000100:00100000:1.0:1788636416.485968:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 76 00000100:00100000:1.0:1788636416.485979:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+54:10459:x1875520963779200:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636416.486002:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636416.486035:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515560f expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.486099:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.486114:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.486236:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:1.0:1788636416.486240:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636416.486244:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a000, rc 0) 00000100:00100000:1.0:1788636416.486302:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+55:10459:x1875520963779200:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 325us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636416.486309:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 76 00000100:00100000:0.0:1788636416.504175:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.504334:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963779328 00000100:00100000:3.0:1788636416.504345:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963779328 00000100:00100000:3.0:1788636416.504395:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:3.0:1788636416.504404:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1875520963779328:12345-192.168.203.57@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788636416.504438:0:6963:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp t0 exp 0000000000000000 cur 285 last 0 00000020:00000080:3.0:1788636416.504468:0:6963:0:(genops.c:1385:class_connect()) connect: client 38630149-ece4-4de3-88b1-a62e16a39489, cookie 0xa6aa59fb12fa7806 00002000:00100000:3.0:1788636416.504480:0:6963:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 38630149-ece4-4de3-88b1-a62e16a39489/ffff9cfd6f5e5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788636416.504505:0:6963:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788636416.504746:0:6963:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788636416.504775:0:6963:0:(import.c:65:import_set_state_nolock()) ffff9cfd6f5e0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636416.504858:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2359:x1875520963779328:12345-192.168.203.57@tcp:8:lhsmtool_posix.0 Request processed in 453us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.504879:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:1.0:1788636416.538280:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636416.538360:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963779456 00000100:00100000:2.0:1788636416.538370:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963779456 00000100:00100000:2.0:1788636416.538437:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:2.0:1788636416.538447:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:0:x1875520963779456:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788636416.540207:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636416.589823:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636416.589867:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636416.589902:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.590227:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963779712 00000100:00100000:3.0:1788636416.590248:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963779712 00000100:00080000:1.0:1788636416.590314:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636416.590350:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963779584 00000100:00100000:2.0:1788636416.590357:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963779584 00000100:00100000:2.0:1788636416.590406:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 283 00000100:00100000:2.0:1788636416.590418:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963779584:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636416.590523:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963779584:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 107us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636416.590532:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 283 00000100:00100000:3.0:1788636416.600587:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963779840 00000100:00100000:3.0:1788636416.600602:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963779840 00000100:00100000:3.0:1788636416.600705:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 127 00000100:00100000:3.0:1788636416.600720:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963779840:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636416.600818:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963779840:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 102us (10914us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.600825:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 127 00000100:00100000:3.0:1788636416.600858:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 73 00000100:00100000:3.0:1788636416.600866:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963779712:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636416.600891:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963779712:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 26us (11108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.600896:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 73 00000100:00080000:2.0:1788636416.601111:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788636416.610232:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636416.678006:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:0:x1875520963779456:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 139548us (139724us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788636416.678031:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 25 00000001:00080000:2.0:1788636416.682129:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:2.0:1788636416.682149:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000100:00100000:1.0:1788636416.697532:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636416.698295:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963780096 00000100:00100000:0.0:1788636416.698316:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963780096 00000100:00100000:0.0:1788636416.698408:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:0.0:1788636416.698422:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+55:10459:x1875520963780096:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788636416.698774:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+56:10459:x1875520963780096:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 354us (1249us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788636416.698783:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:1.0:1788636416.705173:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.706945:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963780352 00000100:00100000:3.0:1788636416.706960:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963780352 00000100:00100000:3.0:1788636416.707045:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 77 00000100:00100000:3.0:1788636416.707058:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+56:10459:x1875520963780352:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636416.707212:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+56:10459:x1875520963780352:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 157us (2050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.707235:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 77 00000100:00100000:3.0:1788636416.711996:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.712055:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963780480 00000100:00100000:3.0:1788636416.712067:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963780480 00000100:00100000:3.0:1788636416.712143:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 78 00000100:00100000:3.0:1788636416.712156:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+56:10459:x1875520963780480:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.712185:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636416.712215:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa780d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155616 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.712353:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7814 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.714129:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.714160:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636416.714227:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636416.714253:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7814 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.714299:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa780d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155616 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.714336:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7814 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155616 expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.714358:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:3.0:1788636416.714362:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788636416.716509:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636416.717875:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75865500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+57:10459:x1875520963780480:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 5706us (5882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.717889:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 78 00000100:00100000:1.0:1788636416.737625:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.737712:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963780608 00000100:00100000:3.0:1788636416.737725:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963780608 00000100:00100000:3.0:1788636416.737828:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:3.0:1788636416.737840:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963780608:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.737864:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636416.737895:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515561d expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788636416.737929:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6d00, blocks: 0x1 00010000:00010000:3.0:1788636416.737952:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=285s v=(0 0) 00010000:00010000:3.0:1788636416.737957:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636416.737979:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.738004:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.738029:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997ca00, rc 0) 00000100:00100000:3.0:1788636416.738099:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963780608:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 261us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.740819:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:3.0:1788636416.747722:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.747767:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963780864 00000100:00100000:3.0:1788636416.747780:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963780864 00000100:00100000:3.0:1788636416.747863:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 79 00000100:00100000:3.0:1788636416.747875:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+57:10459:x1875520963780864:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636416.748046:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75865880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+57:10459:x1875520963780864:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 170us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.748053:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 79 00000100:00100000:3.0:1788636416.760222:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.760270:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963780992 00000100:00100000:3.0:1788636416.760282:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963780992 00000100:00100000:3.0:1788636416.760342:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:3.0:1788636416.760353:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:10459:x1875520963780992:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.760375:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636416.760399:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155624 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.760439:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.760449:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636416.760454:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636416.760459:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 7 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.760508:0:6963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.760525:0:6963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 7 pid: 6661 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636416.760542:0:6963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75864a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6963:1875520976386944:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636416.760650:0:6963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c9b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636416.776435:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636416.777282:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963781120 00000100:00100000:2.0:1788636416.777298:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963781120 00010000:00010000:2.0:1788636416.777372:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 8 pid: 6661 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636416.777432:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:2.0:1788636416.777445:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963781120:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636416.777478:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636416.777510:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 8 pid: 6661 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.777527:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 8 pid: 6661 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.777561:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636416.777567:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636416.777578:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 8 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.777601:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 8 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.777853:0:6675:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 8 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636416.777874:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6675:1875520976387072:192.168.203.57@tcp:105: 00000100:00100000:1.0:1788636416.778116:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd457f20c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788636416.782442:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa781b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515561d expref: 8 pid: 6661 timeout: 385 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636416.782475:0:6963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75864a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6963:1875520976386944:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636416.782515:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 7 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.782535:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c400, rc 0) 00000100:00100000:3.0:1788636416.782972:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+7:10459:x1875520963780992:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 22617us (22762us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636416.782984:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:1.0:1788636416.783759:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6675:1875520976387072:192.168.203.57@tcp:105: 00010000:00010000:1.0:1788636416.783785:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636416.783867:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963781120:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 6423us (7507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636416.783879:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:2.0:1788636416.788894:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636416.789086:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963781248 00000100:00100000:0.0:1788636416.789101:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963781248 00002000:00100000:0.0:1788636416.789174:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cfd6f5d8a80 x1875520963781248/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:657/0 lens 504/0 e 0 to 0 dl 1788636427 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636416.789186:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6f5d8a80 with x1875520963781248 ext(0->8) 00002000:00010000:0.0:1788636416.789193:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd6f5d8a80 00000100:00100000:0.0:1788636416.789460:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:0.0:1788636416.789473:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963781248:12345-192.168.203.57@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788636416.794146:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963781248:12345-192.168.203.57@tcp:4:lhsmtool_posix.0 Request processed in 4667us (5259us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788636416.794159:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00002000:00100000:0.0:1788636416.794171:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cfd6f5d8a80 x1875520963781248/t4294967302(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:657/0 lens 504/448 e 0 to 0 dl 1788636427 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636416.794182:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6f5d8a80 with x1875520963781248 ext(0->8) 00002000:00010000:0.0:1788636416.794188:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd6f5d8a80 00000100:00100000:0.0:1788636416.797000:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636416.797067:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963781376 00000100:00100000:1.0:1788636416.797080:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963781376 00000100:00100000:1.0:1788636416.797156:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 80 00000100:00100000:1.0:1788636416.797169:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+57:10459:x1875520963781376:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788636416.836207:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1788636416.836222:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788636416.836248:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788636416.836298:0:5832:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cfd7faf1b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788636416.836302:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd6999f600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd5017e240 00000020:00080000:2.0:1788636416.836305:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd6999fc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd75826800 00000004:00080000:2.0:1788636416.836340:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788636416.836415:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788636416.836536:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788636416.836832:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976387200:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788636416.836896:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636416.836959:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636416.836966:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976387328:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788636416.836989:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636416.837064:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976387200 00000100:00100000:0.0:1788636416.837073:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976387200 00000100:00100000:0.0:1788636416.837134:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976387328 00000100:00100000:0.0:1788636416.837137:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976387328 00000100:00100000:0.0:1788636416.837158:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788636416.837166:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976387200:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788636416.837300:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788636416.837303:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788636417 00002000:00010000:0.0:1788636416.837306:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788636416.837308:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788636416 -> 1788636417 00002000:00010000:0.0:1788636416.837310:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788636416.837358:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976387200:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (460us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788636416.837365:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788636416.837381:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636416.837387:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976387328:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788636416.837401:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788636416.837437:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9c6cfe, atime: 0x6a9c6cfe, ctime: 0x6a9c6cfe, blocks: 0x1 00010000:00010000:0.0:1788636416.837445:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.837461:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=285s v=(0 0) 00010000:00010000:0.0:1788636416.837466:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636416.837472:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.837488:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.837499:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.837507:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.837525:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788636416.838061:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1875520976387328:12345-0@lo:6:osp-syn-0-0.0 Request processed in 672us (1068us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788636416.838068:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788636416.838100:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636416.838106:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.838115:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191cc00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636416.838125:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.838136:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.838153:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.838160:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000befb9b6f/0xa6aa59fb12fa7829 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.838178:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636416.838179:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636416.838181:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788636416.838214:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd610eaa00/2, rc 0, transno 4294967301 00000100:00100000:0.0:1788636416.838220:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610eaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976387328:0@lo:6:osp-syn-0-0.0 00000004:00080000:0.0:1788636416.838233:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd75864a80/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788636416.838237:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976387200:0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788636416.838406:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636416.839145:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+13:10459:x1875520963781376:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 Request processed in 41976us (42153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636416.839155:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 80 00000100:00100000:3.0:1788636416.843719:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636416.843873:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963781504 00000100:00100000:0.0:1788636416.843896:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963781504 00000100:00100000:0.0:1788636416.843982:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:0.0:1788636416.843995:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963781504:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1788636416.879274:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:2.0:1788636416.879294:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788636416.879719:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75865180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963781504:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 Request processed in 35637us (35926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636416.879732:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:1.0:1788636416.885901:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.885987:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963781760 00000100:00100000:3.0:1788636416.886011:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963781760 00000100:00100000:3.0:1788636416.886082:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 81 00000100:00100000:3.0:1788636416.886093:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+13:10459:x1875520963781760:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.886146:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636416.886177:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7814 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155616 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.886199:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:3.0:1788636416.886204:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636416.886235:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.886248:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.886258:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636416.886511:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dec7142 reply state 000000002eaba505 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636416.886520:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636416.886610:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:10459:x1875520963781760:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 519us (716us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1788636416.886618:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 81 00010000:00010000:3.0:1788636416.891678:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.891695:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.891720:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.891727:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fdc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636416.891732:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.891741:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.891759:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:3.0:1788636416.891762:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636416.891768:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.891775:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7830 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636416.901052:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636416.901107:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963781888 00000100:00100000:0.0:1788636416.901130:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963781888 00000100:00100000:0.0:1788636416.901199:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 31 00000100:00100000:0.0:1788636416.901209:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963781888:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788636416.901734:0:6963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1788636416.901738:0:6963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788636417 -> 1788636415 00002000:00010000:0.0:1788636416.901741:0:6963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788636414 00002000:00010000:0.0:1788636416.901743:0:6963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788636417 -> 1788636415 00002000:00010000:0.0:1788636416.901745:0:6963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1788636416.901834:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963781888:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 625us (791us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1788636416.901843:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 31 00000100:00100000:0.0:1788636416.925064:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.925176:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963782144 00000100:00100000:3.0:1788636416.925187:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963782144 00000100:00100000:3.0:1788636416.925250:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 82 00000100:00100000:3.0:1788636416.925261:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+13:10459:x1875520963782144:12345-192.168.203.57@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.925328:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.925346:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.925357:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.925405:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.925419:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 13 pid: 5811 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636416.925434:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75866300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976387456:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636416.925531:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636416.931458:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75866300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976387456:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636416.931488:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636416.948780:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636416.949103:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963782272 00000100:00100000:2.0:1788636416.949113:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963782272 00010000:00010000:2.0:1788636416.949680:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 14 pid: 5811 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636416.949767:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 43 00000100:00100000:2.0:1788636416.949779:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+14:2363:x1875520963782272:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636416.949819:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636416.949827:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 14 pid: 5811 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.949841:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 14 pid: 5811 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.949866:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa77f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155608 expref: 14 pid: 5811 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.949909:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:2.0:1788636416.949914:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.949924:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.949933:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.949971:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636416.950036:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610ea300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+13:2363:x1875520963782272:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 259us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636416.950043:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 43 00010000:00010000:3.0:1788636416.950357:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.950366:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.950409:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.950416:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.950422:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.950428:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fdc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636416.950433:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.950440:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.950459:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:3.0:1788636416.950471:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788636416.950476:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.950483:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7837 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636416.950847:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+12:10459:x1875520963782144:12345-192.168.203.57@tcp:55:lhsmtool_posix.0 Request processed in 25586us (25792us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788636416.950857:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 82 00000100:00100000:0.0:1788636416.955118:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636416.955648:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963782400 00000100:00100000:3.0:1788636416.955661:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963782400 00000100:00100000:3.0:1788636416.955720:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 32 00000100:00100000:3.0:1788636416.955730:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963782400:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788636416.955770:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.955790:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 7 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.955846:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636416.955851:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636416.955857:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.955906:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 7 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.955934:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 7 pid: 6963 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636416.955950:0:6662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75866300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976387584:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636416.956034:0:6662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636416.959836:0:6662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75866300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976387584:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636416.959869:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636416.960315:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636416.960502:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963782528 00000100:00100000:1.0:1788636416.960509:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963782528 00010000:00010000:1.0:1788636416.960546:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 8 pid: 6963 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636416.960600:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:1.0:1788636416.960610:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+8:2363:x1875520963782528:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636416.960625:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636416.960649:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 8 pid: 6963 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.960662:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 8 pid: 6963 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.960684:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa7822 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155624 expref: 8 pid: 6963 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.960700:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636416.960705:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636416.960711:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.960722:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.960824:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636416.960871:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963782528:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 262us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636416.960879:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 44 00010000:00010000:2.0:1788636416.962523:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.962540:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.963005:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.963017:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.963037:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.963061:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636416.963065:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.963075:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.963093:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.963101:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa783e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636416.963518:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963782400:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 Request processed in 7784us (8403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636416.963528:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 32 00000100:00100000:0.0:1788636416.966237:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636416.966328:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963782784 00000100:00100000:2.0:1788636416.966560:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963782784 00000100:00100000:2.0:1788636416.966822:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 83 00000100:00100000:2.0:1788636416.966833:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+12:10459:x1875520963782784:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788636416.966912:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.966930:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.966960:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.967575:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.967590:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.967599:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.967632:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 13 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636416.967647:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 13 pid: 5810 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636416.967661:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976387712:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636416.968360:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e5b000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636416.973730:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636416.974113:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5d9180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976387712:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636416.974143:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636416.977381:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963782912 00000100:00100000:0.0:1788636416.977396:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963782912 00010000:00010000:0.0:1788636416.977445:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 14 pid: 5810 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636416.977489:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:0.0:1788636416.977512:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:2362:x1875520963782912:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636416.977527:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636416.977535:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 14 pid: 5810 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.977548:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 14 pid: 5810 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.977572:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa77ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515560f expref: 14 pid: 5810 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.977588:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:0.0:1788636416.977594:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.977603:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.977611:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636416.977648:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636416.977702:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+13:2362:x1875520963782912:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 191us (3981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636416.977710:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 45 00010000:00010000:3.0:1788636416.977840:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636416.977849:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636416.978017:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1788636416.978185:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1788636416.978231:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1788636416.978308:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75866300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5811:1875520976387840:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788636416.978387:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636416.978421:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c93c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636416.979297:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976387840 00000100:00100000:0.0:1788636416.979305:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976387840 00000100:00100000:0.0:1788636416.979359:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636416.979367:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5811:x1875520976387840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1788636416.979454:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5811:x1875520976387840:12345-0@lo:1000:mdt00_001.0 Request processed in 88us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636416.979461:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636416.980087:0:5811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1788636416.980094:0:5811:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd75864a80, transno 4294967303 00000100:00100000:1.0:1788636416.980117:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75866300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5811:1875520976387840:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1788636416.980619:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1788636416.980703:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5811:1875520976387968:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1788636416.980757:0:5811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636416.980783:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636416.981606:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976387968 00000100:00100000:3.0:1788636416.981614:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976387968 00000100:00100000:3.0:1788636416.981658:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636416.981666:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5811:x1875520976387968:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1788636416.981857:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5811:x1875520976387968:12345-0@lo:1000:mdt00_001.0 Request processed in 191us (1099us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788636416.981873:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636416.982306:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5811:1875520976387968:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1788636416.982460:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982472:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982479:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982485:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636416.982490:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982498:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982513:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd42a85b00) 00010000:00010000:1.0:1788636416.982516:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636416.982521:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982540:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa784c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982578:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982584:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982589:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982593:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636416.982596:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982601:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982609:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:1.0:1788636416.982612:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636416.982615:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982621:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa777a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982641:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982655:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 16 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982670:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982700:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 16 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636416.982716:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 16 pid: 7975 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636416.982729:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976388096:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636416.982884:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c9600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636416.997328:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976388096:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636416.998579:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636417.000252:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636417.006015:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963783040 00000100:00100000:0.0:1788636417.006042:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963783040 00010000:00010000:0.0:1788636417.006191:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 17 pid: 7975 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636417.006237:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:0.0:1788636417.006248:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+17:2363:x1875520963783040:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636417.006263:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636417.006270:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 17 pid: 7975 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.006282:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 17 pid: 7975 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.006305:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7796 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351555f3 expref: 17 pid: 7975 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.006322:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:0.0:1788636417.006328:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.006352:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.006361:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.006644:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636417.006712:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+16:2363:x1875520963783040:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 466us (6466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636417.006721:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 46 00010000:00010000:3.0:1788636417.006979:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.006988:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007001:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007008:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007016:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007034:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196aa00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636417.007039:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007046:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007057:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:3.0:1788636417.007061:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636417.007065:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007079:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7853 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007093:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007100:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007106:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007112:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636417.007115:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007122:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007141:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:3.0:1788636417.007144:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636417.007147:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636417.007153:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7845 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636417.007521:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+15:10459:x1875520963782784:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 40687us (41365us total) trans 4294967360 rc 0/0 00000100:00100000:3.0:1788636417.007530:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 83 00000020:00080000:3.0:1788636417.007541:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788636417.012788:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636417.012825:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636417.012889:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788636417.012896:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636417.015045:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636417.015139:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963783296 00000100:00100000:0.0:1788636417.015148:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963783296 00000100:00100000:0.0:1788636417.015208:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:0.0:1788636417.015218:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+15:10459:x1875520963783296:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788636417.015894:0:5813:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788636417.015989:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:0.0:1788636417.016046:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.016061:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.016073:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.016082:0:5813:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.016089:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.016106:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636417.016119:0:5813:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788636417.016202:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+17:10459:x1875520963783296:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 983us (1165us total) trans 4294967362 rc 0/0 00000100:00100000:0.0:1788636417.016210:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 20 00000020:00080000:0.0:1788636417.016215:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788636417.017262:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636417.017271:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636417.017279:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636417.017284:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636417.017292:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636417.017305:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cfd500eb300) 00010000:00010000:1.0:1788636417.017308:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788636417.017313:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636417.017347:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa785a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636417.017367:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636417.017376:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636417.017378:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788636417.019059:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788636417.669776:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788636418.377103:0:12036:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636418.377113:0:12036:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636418.377152:0:12036:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1788636418.377159:0:12036:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636418.505781:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636418.505933:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963783552 00000100:00100000:2.0:1788636418.505944:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963783552 00000100:00100000:2.0:1788636418.505998:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:2.0:1788636418.506028:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+17:10477:x1875520963783552:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636418.506051:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636418.506072:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7861 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515562b expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.506161:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7868 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.506177:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.506190:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7868 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636418.506200:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788636418.506314:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7861 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515562b expref: 20 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.506330:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7868 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515562b expref: 19 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.506339:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636418.506342:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636418.506345:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eae00, rc 0) 00000100:00100000:2.0:1788636418.506404:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+19:10477:x1875520963783552:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 379us (632us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788636418.506412:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:2.0:1788636418.515973:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636418.519149:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963783680 00000100:00100000:3.0:1788636418.519162:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963783680 00000100:00100000:2.0:1788636418.521958:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 85 00000100:00100000:2.0:1788636418.521976:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:10477:x1875520963783680:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:2.0:1788636418.522057:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522073:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522084:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522098:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522105:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522111:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522329:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522339:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522346:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636418.522384:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522396:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522407:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522413:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522419:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebe00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.522422:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522429:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522440:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636418.522443:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.522447:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522453:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7876 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522462:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522468:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522474:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522477:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.522485:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522492:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522499:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd62575200) 00010000:00010000:2.0:1788636418.522502:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.522506:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522511:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa787d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522525:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522531:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522536:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522540:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.522542:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522547:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522554:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575e00) 00010000:00010000:2.0:1788636418.522556:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.522564:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.522570:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7884 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636418.523026:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:10477:x1875520963783680:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 1049us (7060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636418.523036:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 85 00000100:00100000:1.0:1788636418.582590:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636418.583067:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963783936 00000100:00100000:2.0:1788636418.583077:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963783936 00000100:00100000:2.0:1788636418.583221:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 86 00000100:00100000:2.0:1788636418.583233:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+19:10480:x1875520963783936:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636418.583252:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636418.583274:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa788b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155632 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.583345:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.583360:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.583372:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.583386:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.583393:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.583416:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587272:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587291:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587305:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636418.587317:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788636418.587413:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587421:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587428:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587434:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.587439:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587447:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587461:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636418.587464:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.587478:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.587485:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7892 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588565:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588575:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588582:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588588:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebe00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.588591:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588598:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588610:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd62575e00) 00010000:00010000:2.0:1788636418.588613:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.588617:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588623:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7899 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588679:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa788b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 22 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588714:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 21 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.588722:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:2.0:1788636418.588724:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636418.588736:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eaa00, rc 0) 00000100:00100000:2.0:1788636418.588826:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+21:10480:x1875520963783936:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 5594us (6315us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1788636418.588836:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 86 00000100:00100000:1.0:1788636418.593981:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636418.594043:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963784064 00000100:00100000:3.0:1788636418.594052:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963784064 00000100:00100000:3.0:1788636418.594470:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 87 00000100:00100000:3.0:1788636418.594482:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+21:10480:x1875520963784064:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:3.0:1788636418.594571:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594590:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594601:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594627:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594636:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594642:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594647:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636418.594651:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594658:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594687:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:3.0:1788636418.594691:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636418.594696:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.594703:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636418.594782:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+21:10480:x1875520963784064:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 301us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636418.594789:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 87 00000100:00100000:0.0:1788636418.597780:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636418.598342:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963784320 00000100:00100000:2.0:1788636418.598352:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963784320 00000100:00100000:2.0:1788636418.598433:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:2.0:1788636418.598444:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd4841b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+21:10480:x1875520963784320:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636418.598690:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd4841b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+22:10480:x1875520963784320:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 247us (920us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788636418.598698:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:2.0:1788636418.649091:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636418.649291:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963784576 00000100:00100000:1.0:1788636418.649302:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963784576 00000100:00100000:1.0:1788636418.649372:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 88 00000100:00100000:1.0:1788636418.649382:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+22:10000:x1875520963784576:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636418.649407:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636418.649427:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa78b5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155639 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.649524:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.649539:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.649549:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.649598:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 23 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.649611:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 23 pid: 7975 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636418.649624:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976388224:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636418.649716:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd45190c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636418.655431:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636418.655534:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976388224:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636418.655562:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636418.659281:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963784704 00000100:00100000:0.0:1788636418.659295:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963784704 00010000:00010000:0.0:1788636418.659342:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 24 pid: 7975 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636418.659392:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 47 00000100:00100000:0.0:1788636418.659403:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+24:2362:x1875520963784704:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636418.659418:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636418.659424:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 24 pid: 7975 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.659438:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 24 pid: 7975 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.659461:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa78a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155632 expref: 24 pid: 7975 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.659509:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:0.0:1788636418.659522:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.659530:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.659537:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.659569:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636418.659606:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.659614:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636418.659631:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00000100:00100000:0.0:1788636418.659643:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+23:2362:x1875520963784704:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 241us (4221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636418.659650:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 47 00010000:00010000:3.0:1788636418.659786:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa78b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.659831:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.659839:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:3.0:1788636418.659848:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788636418.659850:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a800, rc 0) 00000100:00100000:3.0:1788636418.659887:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+23:10000:x1875520963784576:12345-192.168.203.57@tcp:101:bash.0 Request processed in 10507us (10804us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1788636418.659894:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 88 00000100:00100000:0.0:1788636418.667144:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636418.667214:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963784960 00000100:00100000:1.0:1788636418.667224:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963784960 00000100:00100000:1.0:1788636418.667334:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 89 00000100:00100000:1.0:1788636418.667345:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+23:10000:x1875520963784960:12345-192.168.203.57@tcp:36:bash.0 00010000:00010000:1.0:1788636418.669204:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.669223:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.669235:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636418.669286:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1788636418.669311:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c846151b reply state 00000000170861bd transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636418.669321:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788636418.669493:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1788636418.669702:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+27:10000:x1875520963784960:12345-192.168.203.57@tcp:36:bash.0 Request processed in 2356us (2565us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1788636418.669711:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 89 00000020:00080000:1.0:1788636418.669716:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1788636418.678352:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636418.678422:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963785088 00000100:00100000:3.0:1788636418.678432:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963785088 00010000:00010000:1.0:1788636418.679030:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.679044:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.679052:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.679060:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636418.679065:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.679074:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.679090:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:1.0:1788636418.679093:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636418.679099:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.679105:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa78ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636418.679867:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 90 00000100:00100000:3.0:1788636418.679884:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+26:10000:x1875520963785088:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:3.0:1788636418.679909:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636418.679928:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155640 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.679985:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155640 expref: 27 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.679999:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155640 expref: 27 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636418.680026:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:3.0:1788636418.680029:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636418.680032:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd820fc600, rc 0) 00000100:00100000:3.0:1788636418.680097:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+27:10000:x1875520963785088:12345-192.168.203.57@tcp:101:bash.0 Request processed in 220us (1754us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636418.680105:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 90 00010000:00010000:0.0:1788636418.687108:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636418.687362:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976388352:0@lo:400:kworker.0 00000100:00100000:0.0:1788636418.687371:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976388608:0@lo:400:kworker.0 00000100:00100000:3.0:1788636418.687429:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976388480:0@lo:400:kworker.0 00000100:00100000:0.0:1788636418.694292:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636418.694366:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636418.694379:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976388736:0@lo:400:kworker.0 00000100:00100000:0.0:1788636418.694415:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636418.694460:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976388736 00000100:00100000:0.0:1788636418.694467:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976388736 00000100:00100000:0.0:1788636418.694521:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636418.694531:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1875520976388736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636418.694582:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3280:x1875520976388736:12345-0@lo:400:kworker.0 Request processed in 53us (165us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636418.694604:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1788636418.694625:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636418.694657:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976388736:0@lo:400:kworker.0 00000100:00100000:0.0:1788636418.694685:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976388608 00000100:00100000:0.0:1788636418.694688:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976388608 00000100:00100000:0.0:1788636418.694719:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788636418.694726:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976388608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636418.694763:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976388608:12345-0@lo:400:kworker.0 Request processed in 38us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636418.694769:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:0.0:1788636418.694783:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636418.694815:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610eb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976388608:0@lo:400:kworker.0 00000100:00100000:1.0:1788636418.696926:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636418.696980:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976388864:0@lo:400:kworker.0 00000100:00100000:1.0:1788636418.697041:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636418.697080:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976388864 00000100:00100000:1.0:1788636418.697088:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976388864 00000100:00100000:0.0:1788636418.697319:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976388352 00000100:00100000:0.0:1788636418.697324:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976388352 00000100:00100000:0.0:1788636418.697360:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788636418.697370:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976388352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636418.697424:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976388352:12345-0@lo:400:kworker.0 Request processed in 56us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636418.697431:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788636418.697481:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610e9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976388352:0@lo:400:kworker.0 00000100:00100000:1.0:1788636418.698064:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788636418.698072:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875520976388864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636418.698277:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875520976388864:12345-0@lo:400:kworker.0 Request processed in 205us (1234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636418.698285:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1788636418.699754:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636418.699838:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976388864:0@lo:400:kworker.0 00000100:00100000:0.0:1788636418.702974:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636418.703288:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963785216 00000100:00100000:1.0:1788636418.703298:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963785216 00000100:00100000:1.0:1788636418.703364:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00100000:1.0:1788636418.703374:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:10000:x1875520963785216:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636418.703390:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636418.703409:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155647 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636418.703434:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c6cff, atime: 0x6a9c6cfe, ctime: 0x6a9c6cff, blocks: 0xb 00010000:00010000:1.0:1788636418.703454:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=287s v=(0 0) 00010000:00010000:1.0:1788636418.703459:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636418.703466:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.703484:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.703496:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196b600, rc 0) 00000100:00100000:1.0:1788636418.703564:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:10000:x1875520963785216:12345-192.168.203.57@tcp:101:bash.0 Request processed in 191us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636418.703570:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00080000:0.0:1788636418.703901:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636418.708755:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636418.708845:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976388992:0@lo:400:kworker.0 00000100:00100000:2.0:1788636418.708964:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976388480 00000100:00100000:2.0:1788636418.708972:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976388480 00000100:00100000:2.0:1788636418.709036:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788636418.709046:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976388480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636418.709102:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976388480:12345-0@lo:400:kworker.0 Request processed in 57us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636418.709109:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788636418.709193:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636418.709242:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610e9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976388480:0@lo:400:kworker.0 00000100:00100000:2.0:1788636418.709335:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976388992 00000100:00100000:2.0:1788636418.709345:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976388992 00000100:00100000:2.0:1788636418.709388:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788636418.709394:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f33a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1875520976388992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636418.709430:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f33a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1875520976388992:12345-0@lo:400:kworker.0 Request processed in 36us (236us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636418.709436:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788636418.709594:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976388992:0@lo:400:kworker.0 00000100:00080000:3.0:1788636418.709707:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788636418.711870:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636418.712376:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963785344 00000100:00100000:2.0:1788636418.712387:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963785344 00002000:00010000:2.0:1788636418.712429:0:6665:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788636418.712434:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd7a282680 with x1875520963785344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788636418.712447:0:6665:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd7a282680. 00000100:00100000:2.0:1788636418.712484:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:2.0:1788636418.712494:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2360:x1875520963785344:12345-192.168.203.57@tcp:10:bash.0 00002000:00010000:2.0:1788636418.713049:0:6665:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788636418.713053:0:6665:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788636415 -> 1788636419 00002000:00010000:2.0:1788636418.713056:0:6665:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788636414 -> 1788636414 00002000:00010000:2.0:1788636418.713057:0:6665:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788636415 -> 1788636419 00002000:00010000:2.0:1788636418.713060:0:6665:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788636418.713302:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2360:x1875520963785344:12345-192.168.203.57@tcp:10:bash.0 Request processed in 808us (1439us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788636418.713310:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 1 00002000:00010000:2.0:1788636418.713314:0:6665:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788636418.713316:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd7a282680 with x1875520963785344 ext(0->18446744073709551615) 00002000:00010000:2.0:1788636418.713322:0:6665:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd7a282680. 00000100:00100000:1.0:1788636418.860407:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636418.860503:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963785472 00000100:00100000:2.0:1788636418.860514:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963785472 00000100:00100000:2.0:1788636418.860579:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 91 00000100:00100000:2.0:1788636418.860590:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+27:10494:x1875520963785472:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:2.0:1788636418.860660:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.860677:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.860689:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.860704:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.860711:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.860718:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.860968:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.860987:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.860994:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636418.861044:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861719:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861736:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861742:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861747:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebe00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.861751:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861760:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861771:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636418.861774:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.861778:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861784:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa78df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861818:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861825:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861830:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861842:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.861845:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861851:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.861996:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd62575e00) 00010000:00010000:2.0:1788636418.861998:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.862002:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.862016:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.862033:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.862040:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.862046:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.862051:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.862054:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.862060:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.862079:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:2.0:1788636418.862081:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.862085:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.862090:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636418.862433:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+27:10494:x1875520963785472:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 1843us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636418.862441:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 91 00000100:00100000:0.0:1788636418.938534:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636418.938648:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963785728 00000100:00100000:2.0:1788636418.938659:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963785728 00000100:00100000:2.0:1788636418.938717:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 92 00000100:00100000:2.0:1788636418.938738:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+27:10497:x1875520963785728:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636418.938757:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636418.938778:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515564e expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.938892:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.938907:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.938919:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.938933:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.938954:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.938961:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.939966:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7909 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.940359:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.940371:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7909 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636418.940382:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788636418.941634:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941647:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941655:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941661:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.941665:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941673:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941703:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636418.941706:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.941710:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941716:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa78fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941748:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941755:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941761:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941766:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebe00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636418.941768:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941775:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941782:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd62575e00) 00010000:00010000:2.0:1788636418.941784:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636418.941787:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941793:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7902 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941903:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa78f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515564e expref: 30 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941918:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7909 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515564e expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636418.941926:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:2.0:1788636418.941928:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788636418.941931:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eaa00, rc 0) 00000100:00100000:2.0:1788636418.942016:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+29:10497:x1875520963785728:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 3283us (3482us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1788636418.942025:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 92 00000100:00100000:0.0:1788636418.946462:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636418.946526:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963785856 00000100:00100000:1.0:1788636418.946535:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963785856 00000100:00100000:1.0:1788636418.946590:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 93 00000100:00100000:1.0:1788636418.946599:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+29:10497:x1875520963785856:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:1.0:1788636418.946673:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.946689:0:7975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.946698:0:7975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.946742:0:7975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.946756:0:7975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 29 pid: 5812 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636418.946770:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976389120:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636418.946896:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788636418.955335:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636418.955612:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976389120:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636418.955639:0:7975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636418.955745:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963786112 00000100:00100000:0.0:1788636418.955755:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963786112 00000100:00100000:0.0:1788636418.955843:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:0.0:1788636418.955853:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+30:5597:x1875520963786112:12345-192.168.203.57@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788636418.956410:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+31:5597:x1875520963786112:12345-192.168.203.57@tcp:35:ldlm_bl.0 Request processed in 557us (1084us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788636418.956419:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:0.0:1788636418.960315:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636418.960443:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963786240 00000100:00100000:1.0:1788636418.960453:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963786240 00010000:00010000:1.0:1788636418.960500:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 31 pid: 5812 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636418.960713:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00100000:0.0:1788636418.960725:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+31:2363:x1875520963786240:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636418.960946:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636418.960956:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 31 pid: 5812 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.960971:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 31 pid: 5812 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.960992:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa78bc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155639 expref: 31 pid: 5812 timeout: 387 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.961015:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:0.0:1788636418.961021:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.961029:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.961050:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636418.961082:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636418.961140:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+30:2363:x1875520963786240:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 418us (832us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636418.961147:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 48 00010000:00010000:1.0:1788636418.962524:0:7975:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.962537:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.962572:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.962579:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.962585:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.962591:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ac00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636418.962595:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.962603:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.962617:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:1.0:1788636418.962620:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636418.962688:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636418.962712:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7917 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636418.963184:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a281f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+29:10497:x1875520963785856:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 16583us (16727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636418.963191:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 93 00000100:00100000:0.0:1788636418.965513:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636418.965705:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963786496 00000100:00100000:2.0:1788636418.965714:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963786496 00000100:00100000:2.0:1788636418.966029:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:2.0:1788636418.966040:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+29:10497:x1875520963786496:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636418.966355:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+30:10497:x1875520963786496:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 316us (896us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788636418.966361:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:2.0:1788636419.148055:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636419.148104:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636419.148198:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963786752 00000100:00100000:1.0:1788636419.148208:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963786752 00000100:00100000:1.0:1788636419.148265:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:1.0:1788636419.148275:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2361:x1875520963786752:12345-192.168.203.57@tcp:16:kworker.0 00000100:00100000:0.0:1788636419.150557:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963786624 00000100:00100000:0.0:1788636419.150568:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963786624 00002000:00100000:0.0:1788636419.150612:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9cfd6f5d9880 x1875520963786624/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:660/0 lens 496/0 e 0 to 0 dl 1788636430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636419.150632:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6f5d9880 with x1875520963786624 ext(0->7) 00002000:00010000:0.0:1788636419.150638:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd6f5d9880 00000100:00100000:0.0:1788636419.150662:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:0.0:1788636419.150672:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:38630149-ece4-4de3-88b1-a62e16a39489+9:2361:x1875520963786624:12345-192.168.203.57@tcp:4:bash.0 00000100:00100000:0.0:1788636419.151125:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:38630149-ece4-4de3-88b1-a62e16a39489+11:2361:x1875520963786624:12345-192.168.203.57@tcp:4:bash.0 Request processed in 454us (3018us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788636419.151132:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 2 00002000:00100000:0.0:1788636419.151140:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->7) req@ffff9cfd6f5d9880 x1875520963786624/t4294967307(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:660/0 lens 496/448 e 0 to 0 dl 1788636430 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636419.151148:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6f5d9880 with x1875520963786624 ext(0->7) 00002000:00010000:0.0:1788636419.151152:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd6f5d9880 00000100:00100000:2.0:1788636419.199164:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976389248:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636419.199251:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636419.199327:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976389248 00000100:00100000:2.0:1788636419.199336:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976389248 00000100:00100000:2.0:1788636419.199394:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788636419.199403:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976389248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636419.199426:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636419.199472:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976389248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636419.199479:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788636419.200172:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976389248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636419.211722:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636419.211835:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963787008 00000100:00100000:0.0:1788636419.211844:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963787008 00000100:00100000:0.0:1788636419.211914:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 94 00000100:00100000:0.0:1788636419.211923:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+30:10509:x1875520963787008:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:0.0:1788636419.211945:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636419.211963:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa791e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155655 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212044:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212059:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212072:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212085:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212092:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212098:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212302:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7933 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212312:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212319:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7933 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636419.212339:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:0.0:1788636419.212421:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212430:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212436:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212442:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636419.212446:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212454:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212465:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:0.0:1788636419.212469:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636419.212473:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212479:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7925 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212490:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212496:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212512:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212517:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191da00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636419.212520:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212526:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212533:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd500eb700) 00010000:00010000:0.0:1788636419.212535:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636419.212538:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212544:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa792c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212582:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa791e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155655 expref: 33 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212594:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7933 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155655 expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.212601:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:0.0:1788636419.212603:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636419.212606:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191ce00, rc 0) 00000100:00080000:2.0:1788636419.213930:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636419.216183:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+32:10509:x1875520963787008:12345-192.168.203.57@tcp:101:cat.0 Request processed in 4253us (4462us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1788636419.216203:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 94 00000100:00100000:3.0:1788636419.224080:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636419.224204:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963787264 00000100:00100000:0.0:1788636419.224214:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963787264 00000100:00100000:0.0:1788636419.224273:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:0.0:1788636419.224283:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+32:10509:x1875520963787264:12345-192.168.203.57@tcp:35:cat.0 00000100:00100000:0.0:1788636419.224483:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+33:10509:x1875520963787264:12345-192.168.203.57@tcp:35:cat.0 Request processed in 201us (411us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788636419.224491:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:1.0:1788636419.238945:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+10:2361:x1875520963786752:12345-192.168.203.57@tcp:16:kworker.0 Request processed in 90662us (90891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636419.238957:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 34 00000001:00080000:2.0:1788636419.240046:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:2.0:1788636419.240063:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1788636419.240070:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1788636419.268094:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636419.268176:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963787520 00000100:00100000:3.0:1788636419.268186:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963787520 00000100:00100000:3.0:1788636419.268245:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 95 00000100:00100000:3.0:1788636419.268256:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+33:10510:x1875520963787520:12345-192.168.203.57@tcp:36:rm.0 00010000:00010000:3.0:1788636419.268313:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788636419.268338:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7933 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155655 expref: 33 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268360:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa7909 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515564e expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268374:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa78d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155640 expref: 31 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268387:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:3.0:1788636419.268408:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636419.268426:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268440:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268463:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268477:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268484:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268490:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268670:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268679:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.268686:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636419.269287:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788636419.269297:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 288293500516ns, next at 289293498303ns, rc = 0 00010000:00010000:3.0:1788636419.269352:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269362:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269369:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269386:0:5812:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269393:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269398:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269418:0:5812:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636419.269436:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269442:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269448:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269454:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636419.269458:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269465:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269475:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd42a85c00) 00010000:00010000:3.0:1788636419.269477:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788636419.269481:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269496:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa794f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269512:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269518:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269523:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269528:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fdc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636419.269532:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269537:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269545:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:3.0:1788636419.269547:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636419.269550:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.269555:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa7941 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636419.269565:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000940f5044 reply state 00000000aa00ff2b transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636419.269573:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636419.269653:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+32:10510:x1875520963787520:12345-192.168.203.57@tcp:36:rm.0 Request processed in 1397us (1566us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788636419.269661:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 95 00010000:00010000:0.0:1788636419.270344:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636419.270352:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.270359:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c400 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636419.270363:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.270371:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.270382:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cfd42a85c00) 00010000:00010000:0.0:1788636419.270386:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788636419.270389:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.270395:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7956 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.270412:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636419.270414:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636419.270423:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636419.274243:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.274261:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.274269:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.274275:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fd800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636419.274281:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.274288:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.274303:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd42a85600) 00010000:00010000:3.0:1788636419.274307:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636419.274312:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.274318:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa7948 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636419.295103:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1788636419.295278:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788636419.332579:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636419.333375:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963787776 00000100:00100000:1.0:1788636419.333386:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963787776 00000100:00100000:1.0:1788636419.333447:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 96 00000100:00100000:1.0:1788636419.333457:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+31:10515:x1875520963787776:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636419.333482:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636419.333521:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa795d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515565c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.333644:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.333660:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.333685:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.333701:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.333708:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.333715:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788636419.334427:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788636419.334580:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.334591:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.334599:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.335848:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.335871:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.335878:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.335884:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ba00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636419.335901:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.335910:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.335923:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636419.335926:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636419.335930:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.335936:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7964 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636419.339070:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000486cc494 reply state 000000009ba34306 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636419.339093:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788636419.339157:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa795d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 34 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.339181:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.339191:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636419.339195:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636419.339198:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ac00, rc 0) 00000100:00100000:1.0:1788636419.339285:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+34:10515:x1875520963787776:12345-192.168.203.57@tcp:101:bash.0 Request processed in 5828us (6714us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788636419.339294:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 96 00010000:00010000:1.0:1788636419.341457:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.341474:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.341482:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.341487:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636419.341503:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.341511:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.341545:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd5a43c100) 00010000:00010000:1.0:1788636419.341548:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636419.341552:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.341558:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa796b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636419.346031:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636419.346129:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963787904 00000100:00100000:2.0:1788636419.346139:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963787904 00000100:00100000:2.0:1788636419.346215:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 35 00000100:00100000:2.0:1788636419.346225:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963787904:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:2.0:1788636419.346244:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636419.346263:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155663 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636419.346289:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636419.346307:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=288s v=(0 0) 00010000:00010000:2.0:1788636419.346312:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636419.346321:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.346342:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.346366:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ebc00, rc 0) 00000100:00100000:2.0:1788636419.346424:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963787904:12345-192.168.203.57@tcp:101:bash.0 Request processed in 200us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636419.346431:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 35 00000100:00080000:3.0:1788636419.347144:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636419.356181:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636419.356420:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963788032 00000100:00100000:3.0:1788636419.356431:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963788032 00000100:00100000:0.0:1788636419.356631:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:0.0:1788636419.356643:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:10515:x1875520963788032:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636419.356661:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636419.356681:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515566a expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.356713:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.356721:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636419.356725:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636419.356731:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.356763:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.356777:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 7 pid: 6661 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636419.356790:0:6662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6662:1875520976389376:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636419.356909:0:6662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636419.359254:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636419.359503:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963788160 00000100:00100000:3.0:1788636419.359512:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963788160 00010000:00010000:3.0:1788636419.359549:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 8 pid: 6661 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636419.359589:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:3.0:1788636419.359598:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963788160:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636419.359612:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636419.359634:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 8 pid: 6661 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.359647:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 8 pid: 6661 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.359669:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636419.359673:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636419.359682:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.359692:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.359729:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636419.359743:0:5795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75b9aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1875520976389504:192.168.203.57@tcp:105: 00000100:00100000:3.0:1788636419.359846:0:5795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd540 going to sleep for 11 seconds 00010000:00010000:0.0:1788636419.360483:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c168785/0xa6aa59fb12fa7980 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155663 expref: 8 pid: 6661 timeout: 388 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636419.360509:0:6662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610e9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6662:1875520976389376:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636419.360535:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.360546:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c200, rc 0) 00000100:00100000:0.0:1788636419.360594:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:10515:x1875520963788032:12345-192.168.203.57@tcp:101:bash.0 Request processed in 3953us (4419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636419.360601:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:3.0:1788636419.376310:0:5795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75b9aa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1875520976389504:192.168.203.57@tcp:105: 00010000:00010000:3.0:1788636419.376341:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636419.376404:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963788160:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 16805us (17157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636419.376415:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:2.0:1788636419.377303:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636419.377534:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963788416 00000100:00100000:1.0:1788636419.377542:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963788416 00000100:00100000:1.0:1788636419.377586:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:1.0:1788636419.377595:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+33:10515:x1875520963788416:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:1.0:1788636419.377954:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+34:10515:x1875520963788416:12345-192.168.203.57@tcp:35:bash.0 Request processed in 359us (654us total) trans 4294967377 rc 0/0 00000100:00100000:1.0:1788636419.377961:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:2.0:1788636419.552329:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636419.552490:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963788544 00000100:00100000:3.0:1788636419.552499:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963788544 00000100:00100000:3.0:1788636419.552555:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 97 00000100:00100000:3.0:1788636419.552566:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+34:10532:x1875520963788544:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636419.552588:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636419.552607:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa798e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155671 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.552671:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7995 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.552685:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.552696:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636419.552742:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788636419.552746:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636419.552763:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7995 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.552787:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa798e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155671 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.552871:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7995 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155671 expref: 35 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.552881:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:3.0:1788636419.552883:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636419.552886:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636419.553122:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+35:10532:x1875520963788544:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 388us (631us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636419.553130:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 97 00000100:00100000:0.0:1788636419.557773:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636419.557902:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963788800 00000100:00100000:2.0:1788636419.557911:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963788800 00000100:00100000:2.0:1788636419.557957:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 98 00000100:00100000:2.0:1788636419.557967:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+35:10532:x1875520963788800:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636419.557987:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636419.558017:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa799c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155678 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.558118:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa79a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.558138:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa79a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.558149:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa79a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636419.558158:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788636419.558284:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa799c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155678 expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.558316:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa79a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155678 expref: 37 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.558326:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd5a43c700) 00010000:00010000:2.0:1788636419.558329:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636419.558333:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb800, rc 0) 00000100:00100000:2.0:1788636419.558393:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+37:10532:x1875520963788800:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 427us (628us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1788636419.558401:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 98 00000100:00100000:1.0:1788636419.562373:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636419.562528:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963789056 00000100:00100000:3.0:1788636419.562537:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963789056 00000100:00100000:3.0:1788636419.562586:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 99 00000100:00100000:3.0:1788636419.562596:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+37:10532:x1875520963789056:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636419.562618:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636419.562642:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa79b1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515567f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.562729:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa79b8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.562742:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa79b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.562762:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa79b8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636419.562774:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788636419.563329:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa79b1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515567f expref: 40 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.563350:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa79b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515567f expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.563358:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd5a43c700) 00010000:00010000:3.0:1788636419.563361:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788636419.563364:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d600, rc 0) 00000100:00100000:3.0:1788636419.563486:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+39:10532:x1875520963789056:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 891us (1120us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1788636419.563493:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 99 00000100:00100000:3.0:1788636419.571377:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636419.571470:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963789184 00000100:00100000:1.0:1788636419.571480:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963789184 00000100:00100000:1.0:1788636419.571540:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:1.0:1788636419.571550:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+39:2362:x1875520963789184:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636419.571563:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636419.571586:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa79a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155678 expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.571606:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636419.571611:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636419.571668:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+38:2362:x1875520963789184:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 119us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636419.571675:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:0.0:1788636419.576031:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636419.576729:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963789312 00000100:00100000:2.0:1788636419.576739:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963789312 00000100:00100000:2.0:1788636419.576793:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:2.0:1788636419.576822:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963789312:12345-192.168.203.57@tcp:1:lfs.0 00010000:00010000:2.0:1788636419.576864:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.576886:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.576895:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636419.576900:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636419.576904:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.576939:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 6 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.576989:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 6 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636419.577013:0:6661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1875520976389632:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636419.577116:0:6661:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd699396c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636419.581294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636419.581733:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963789440 00000100:00100000:2.0:1788636419.581743:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963789440 00002000:00100000:2.0:1788636419.581824:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cfd75b9a680 x1875520963789440/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:660/0 lens 504/0 e 0 to 0 dl 1788636430 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788636419.581835:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd75b9a680 with x1875520963789440 ext(0->8) 00010000:00010000:2.0:1788636419.581844:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 7 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.581861:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 7 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636419.581868:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cfd75b9a680 00000100:00100000:2.0:1788636419.581903:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:2.0:1788636419.581913:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963789440:12345-192.168.203.57@tcp:4:lfs.0 00000100:00100000:0.0:1788636419.582475:0:6661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222f800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1875520976389632:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636419.582501:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636419.583215:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963789440:12345-192.168.203.57@tcp:4:lfs.0 Request processed in 1300us (1926us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788636419.583225:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 1 00002000:00100000:2.0:1788636419.583235:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cfd75b9a680 x1875520963789440/t4294967302(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:660/0 lens 504/448 e 0 to 0 dl 1788636430 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788636419.583258:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd75b9a680 with x1875520963789440 ext(0->8) 00010000:00010000:2.0:1788636419.583265:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 9 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.583279:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 9 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636419.583286:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cfd75b9a680 00000100:00100000:2.0:1788636419.586601:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636419.586861:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963789568 00000100:00100000:0.0:1788636419.586871:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963789568 00010000:00010000:0.0:1788636419.586912:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 9 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636419.586957:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:0.0:1788636419.586967:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963789568:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636419.586979:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788636419.586995:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788636419.587018:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788636419 00002000:00010000:0.0:1788636419.587021:0:5797:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788636419 00002000:00010000:0.0:1788636419.587023:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788636419 00010000:00010000:0.0:1788636419.587034:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 9 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.587049:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 9 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.587073:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7987 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515566a expref: 9 pid: 6662 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.587088:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636419.587092:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636419.587098:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.587108:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.587243:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636419.587326:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:2363:x1875520963789568:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 359us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636419.587334:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 50 00010000:00010000:2.0:1788636419.587398:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.587407:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.587431:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.587440:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.587448:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.587455:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eba00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636419.587470:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.587480:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.587493:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.587502:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa79c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636419.587561:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2360:x1875520963789312:12345-192.168.203.57@tcp:1:lfs.0 Request processed in 10741us (11538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636419.587568:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:1.0:1788636419.594300:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636419.600485:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963789824 00000100:00100000:0.0:1788636419.600501:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963789824 00000100:00100000:0.0:1788636419.600571:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:0.0:1788636419.600581:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd507d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+38:10532:x1875520963789824:12345-192.168.203.57@tcp:35:lfs.0 00000004:00010000:0.0:1788636419.600659:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa79b8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515567f expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636419.601475:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788636419.601531:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788636419.603976:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788636419.604088:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.604108:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.604119:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.604157:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.604173:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 42 pid: 5811 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636419.604188:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610eb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1875520976389760:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636419.604340:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636419.608449:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636419.608535:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963789952 00000100:00100000:1.0:1788636419.608543:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963789952 00010000:00010000:1.0:1788636419.608581:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 43 pid: 5811 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636419.608624:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 51 00000100:00100000:1.0:1788636419.608633:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+43:2362:x1875520963789952:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636419.608648:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636419.608655:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 43 pid: 5811 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.608667:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 43 pid: 5811 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.608702:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636419.608707:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.608716:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.608724:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.608839:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636419.608991:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+43:2362:x1875520963789952:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 357us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636419.608999:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 51 00010000:00010000:0.0:1788636419.609416:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7972 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515565c expref: 42 pid: 5811 timeout: 388 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636419.609432:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610eb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1875520976389760:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636419.609451:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.609468:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.609475:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636419.609585:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1788636419.610188:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1788636419.610298:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610eb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976389888:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636419.610347:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636419.610380:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a49c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636419.610477:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976389888 00000100:00100000:3.0:1788636419.610483:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976389888 00000100:00100000:3.0:1788636419.610524:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636419.610533:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976389888:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788636419.610600:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976389888:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 69us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636419.610607:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636419.610682:0:5814:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1788636419.610687:0:5814:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1788636419.610703:0:5814:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd610eaa00, transno 4294967301 00000100:00100000:1.0:1788636419.610722:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610eb800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976389888:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788636419.611485:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1788636419.611545:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976390016:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788636419.611583:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636419.611611:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5017e240 going to sleep for 11 seconds 00000100:00100000:0.0:1788636419.611696:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976390016 00000100:00100000:0.0:1788636419.611701:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976390016 00000100:00100000:0.0:1788636419.612448:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788636419.612461:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976390016:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636419.612624:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5814:x1875520976390016:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 166us (1038us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1788636419.612631:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636419.613354:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976390016:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788636419.613416:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1788636419.613457:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.613481:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.613487:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.613492:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636419.613496:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.613503:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.613516:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636419.613519:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788636419.613523:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.613529:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa79cd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788636419.613703:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788636419.614721:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1788636419.614748:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 288638950769ns, next at 289638947909ns, rc = 0 00000001:00080000:1.0:1788636419.614756:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1788636419.614832:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636419.614835:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788636419.614843:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa79b8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515567f expref: 46 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636419.614999:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd507d5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+45:10532:x1875520963789824:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 14419us (20706us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1788636419.615016:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 26 00000020:00080000:1.0:1788636419.615022:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788636419.621663:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636419.621728:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963790080 00000100:00100000:0.0:1788636419.621736:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963790080 00000100:00100000:0.0:1788636419.621786:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 100 00000100:00100000:0.0:1788636419.621821:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+45:10532:x1875520963790080:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636419.621845:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636419.622051:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa79d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155686 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.622118:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa79d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155686 expref: 46 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.622147:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa79d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155686 expref: 46 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.622167:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636419.622170:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636419.622173:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c800, rc 0) 00000100:00100000:0.0:1788636419.622228:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+46:10532:x1875520963790080:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 434us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636419.622235:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 100 00000100:00100000:2.0:1788636419.626218:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636419.626289:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963790336 00000100:00100000:3.0:1788636419.626299:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963790336 00000100:00100000:3.0:1788636419.626354:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:3.0:1788636419.626363:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+46:10532:x1875520963790336:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636419.626571:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+47:10532:x1875520963790336:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 208us (360us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1788636419.626595:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 27 00010000:00010000:0.0:1788636419.712387:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636419.720765:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636419.720981:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963790464 00000100:00100000:2.0:1788636419.720992:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963790464 00000100:00100000:2.0:1788636419.721060:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 101 00000100:00100000:2.0:1788636419.721070:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+47:10542:x1875520963790464:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:2.0:1788636419.721157:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721175:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721187:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721217:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721225:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721233:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721315:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721322:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721328:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636419.721364:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721375:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721380:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721386:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721390:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636419.721394:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721408:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721420:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:2.0:1788636419.721423:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636419.721428:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721434:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa79db lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721448:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721453:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721458:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721463:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636419.721466:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721471:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721477:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd62575600) 00010000:00010000:2.0:1788636419.721479:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636419.721481:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721494:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa79e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721510:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721515:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721520:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721524:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636419.721526:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721532:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721540:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:2.0:1788636419.721542:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636419.721545:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.721550:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa79e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636419.721627:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+47:10542:x1875520963790464:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 558us (870us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636419.721634:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 101 00000100:00100000:2.0:1788636419.782625:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636419.782714:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963790720 00000100:00100000:1.0:1788636419.782723:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963790720 00000100:00100000:1.0:1788636419.782790:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 102 00000100:00100000:1.0:1788636419.782849:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+47:10545:x1875520963790720:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636419.782873:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636419.782893:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa79f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515568d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.782962:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.782978:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.782989:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783011:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783019:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783025:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783398:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783407:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783414:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636419.783424:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788636419.783516:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783523:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783529:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783535:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636419.783539:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783546:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783557:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636419.783560:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636419.783564:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783580:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa79f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783594:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783601:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783607:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783612:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636419.783615:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783621:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783628:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636419.783631:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636419.783633:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783638:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa79fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783676:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa79f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515568d expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783689:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515568d expref: 49 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.783703:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636419.783705:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636419.783708:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196bc00, rc 0) 00000100:00100000:1.0:1788636419.783831:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+49:10545:x1875520963790720:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 992us (1218us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1788636419.783928:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 102 00000100:00100000:3.0:1788636419.800031:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636419.801501:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963790848 00000100:00100000:2.0:1788636419.801513:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963790848 00000100:00100000:2.0:1788636419.801632:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 103 00000100:00100000:2.0:1788636419.801644:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+49:10545:x1875520963790848:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:2.0:1788636419.801714:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801730:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801741:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801765:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801771:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801777:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801784:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636419.801788:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801810:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801822:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:2.0:1788636419.801826:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636419.801844:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636419.801862:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb200/0xa6aa59fb12fa7a13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636419.801949:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+49:10545:x1875520963790848:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 307us (1926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636419.801968:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 103 00000100:00100000:1.0:1788636419.807935:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636419.809765:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963791104 00000100:00100000:3.0:1788636419.809779:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963791104 00000100:00100000:3.0:1788636419.809855:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 28 00000100:00100000:3.0:1788636419.809866:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+49:10545:x1875520963791104:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636419.810454:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+50:10545:x1875520963791104:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 588us (2526us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788636419.810463:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 28 00000100:00100000:3.0:1788636419.909754:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636419.909873:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963791360 00000100:00100000:0.0:1788636419.909882:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963791360 00000100:00100000:0.0:1788636419.909943:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 104 00000100:00100000:0.0:1788636419.909953:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+50:10555:x1875520963791360:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636419.909976:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636419.909979:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788636419.910015:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7995 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155671 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.910037:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:0.0:1788636419.910043:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636419.910056:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7a1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155694 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.910247:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7a21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.910277:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.910286:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7a21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636419.910300:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788636419.910491:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7a1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155694 expref: 52 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.910507:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7a21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155694 expref: 51 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.910514:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636419.910516:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636419.910519:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191dc00, rc 0) 00000100:00100000:0.0:1788636419.910623:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+51:10555:x1875520963791360:12345-192.168.203.57@tcp:101:bash.0 Request processed in 670us (877us total) trans 4294967392 rc 0/0 00000100:00100000:0.0:1788636419.910630:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 104 00000100:00100000:2.0:1788636419.915962:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636419.916033:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963791616 00000100:00100000:1.0:1788636419.916044:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963791616 00000100:00100000:1.0:1788636419.916110:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 105 00000100:00100000:1.0:1788636419.916120:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+51:10555:x1875520963791616:12345-192.168.203.57@tcp:36:bash.0 00010000:00010000:1.0:1788636419.916189:0:7975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788636419.916216:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7a21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155694 expref: 51 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.916237:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515568d expref: 50 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.916248:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636419.916253:0:7975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636419.916443:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.916456:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636419.916466:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636419.916547:0:7975:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1788636419.916574:0:7975:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e39a9fa reply state 0000000020bd665f transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636419.916583:0:7975:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636419.916678:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+52:10555:x1875520963791616:12345-192.168.203.57@tcp:36:bash.0 Request processed in 559us (724us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1788636419.916686:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 105 00000020:00080000:1.0:1788636419.916691:0:7975:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788636419.921068:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636419.921250:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963791744 00000100:00100000:0.0:1788636419.921260:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963791744 00000100:00100000:0.0:1788636419.921318:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 106 00000100:00100000:0.0:1788636419.921328:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+52:10555:x1875520963791744:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636419.921351:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636419.921373:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7a36 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515569b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.921472:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.921485:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.921492:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.921511:0:5810:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.921521:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922371:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922383:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922391:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922397:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636419.922402:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922409:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922426:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:3.0:1788636419.922441:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636419.922444:0:3266:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922451:0:3266:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922457:0:3266:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922483:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636419.922490:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7a2f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.922560:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.922568:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636419.922611:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788636419.922616:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636419.922634:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.922663:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7a36 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 53 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.922678:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 52 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636419.922692:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636419.922694:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636419.922697:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c400, rc 0) 00000100:00100000:0.0:1788636419.922765:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+52:10555:x1875520963791744:12345-192.168.203.57@tcp:101:bash.0 Request processed in 1438us (1707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636419.922773:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 106 00000100:00100000:2.0:1788636419.928714:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636419.928828:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963792000 00000100:00100000:1.0:1788636419.928838:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963792000 00000100:00100000:1.0:1788636419.928895:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 29 00000100:00100000:1.0:1788636419.928904:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+52:10555:x1875520963792000:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:1.0:1788636419.929339:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+53:10555:x1875520963792000:12345-192.168.203.57@tcp:35:bash.0 Request processed in 435us (632us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1788636419.929347:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 29 00000100:00100000:2.0:1788636420.002881:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.003110:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963792128 00000100:00100000:1.0:1788636420.003286:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963792128 00000100:00100000:1.0:1788636420.003349:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 107 00000100:00100000:1.0:1788636420.003360:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+53:10561:x1875520963792128:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636420.003384:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636420.003405:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a44 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556a2 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.003467:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7a4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.003494:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.003506:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636420.003541:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788636420.003546:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636420.003563:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7a4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.003587:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a44 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556a2 expref: 55 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.003604:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7a4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556a2 expref: 54 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.003613:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636420.003616:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636420.003620:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a000, rc 0) 00000100:00100000:1.0:1788636420.003767:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+54:10561:x1875520963792128:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 408us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.003774:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 107 00000100:00100000:2.0:1788636420.010352:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.010439:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963792256 00000100:00100000:1.0:1788636420.010449:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963792256 00000100:00100000:1.0:1788636420.010506:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 108 00000100:00100000:1.0:1788636420.010516:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+54:10561:x1875520963792256:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636420.010532:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636420.010562:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556a9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010621:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010634:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010646:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010661:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010668:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010674:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010755:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010764:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010771:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636420.010822:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788636420.010826:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636420.010843:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010872:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010880:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010887:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010894:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010900:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.010904:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010911:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010922:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636420.010925:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.010929:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010935:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010947:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010953:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010964:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010968:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ae00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.010971:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010977:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010984:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636420.010986:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.010988:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.010994:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.011033:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.011047:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.011054:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636420.011056:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636420.011058:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196aa00, rc 0) 00000100:00100000:1.0:1788636420.011120:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+55:10561:x1875520963792256:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 605us (777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.011143:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 108 00000100:00100000:3.0:1788636420.015706:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636420.015748:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.015875:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963792512 00000100:00100000:2.0:1788636420.015884:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963792512 00000100:00100000:2.0:1788636420.015931:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 109 00000100:00100000:2.0:1788636420.015940:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+55:10561:x1875520963792512:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636420.015958:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636420.015976:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7a6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556b0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.016074:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.016089:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.016098:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.016138:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.016172:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.016184:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 56 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.016197:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976390144:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636420.016371:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 56 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.016381:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 56 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.016390:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976390272:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636420.016422:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd69939c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636420.016925:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963792640 00000100:00100000:0.0:1788636420.016931:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963792640 00010000:00010000:0.0:1788636420.016956:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 57 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.016986:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 52 00000100:00100000:0.0:1788636420.016994:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+57:2362:x1875520963792640:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636420.017012:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636420.017018:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 57 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.017030:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 57 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.017046:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636420.017051:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.017058:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.017076:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636420.017117:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+57:2362:x1875520963792640:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 114us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636420.017128:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 52 00010000:00010000:3.0:1788636420.023763:0:5812:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.57@tcp) returned -22 from blocking AST (req@00000000f47bb5ca x1875520976390144) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 56 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.023787:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7a67 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556a9 expref: 56 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636420.023833:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976390144:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636420.024158:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.024273:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963792768 00000100:00100000:1.0:1788636420.024280:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963792768 00010000:00010000:1.0:1788636420.024321:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 56 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.024361:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 53 00000100:00100000:1.0:1788636420.024372:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+56:2363:x1875520963792768:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636420.024386:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636420.024392:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 56 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.024404:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 56 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.024423:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636420.024429:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.024438:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.024445:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.024462:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636420.024510:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+56:2363:x1875520963792768:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.024529:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 53 00010000:00010000:3.0:1788636420.025940:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7a3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515569b expref: 55 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636420.025960:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976390272:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636420.026007:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:3.0:1788636420.026014:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.026023:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.026029:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636420.026049:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788636420.026203:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7a6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.026219:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.026226:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:3.0:1788636420.026228:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788636420.026230:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea600, rc 0) 00000100:00100000:3.0:1788636420.026278:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+55:10561:x1875520963792512:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 10339us (10581us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788636420.026286:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 109 00000100:00100000:0.0:1788636420.040653:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636420.040832:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963793024 00000100:00100000:3.0:1788636420.040843:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963793024 00000100:00100000:3.0:1788636420.040915:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:3.0:1788636420.040935:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+55:10561:x1875520963793024:12345-192.168.203.57@tcp:103:lfs.0 00010000:00010000:3.0:1788636420.040951:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636420.040988:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa79d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155686 expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.041015:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:3.0:1788636420.041021:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636420.041067:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+54:10561:x1875520963793024:12345-192.168.203.57@tcp:103:lfs.0 Request processed in 133us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636420.041074:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:0.0:1788636420.047499:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.049323:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963793152 00000100:00100000:1.0:1788636420.049336:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963793152 00000100:00100000:1.0:1788636420.049444:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 110 00000100:00100000:1.0:1788636420.049456:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+54:10561:x1875520963793152:12345-192.168.203.57@tcp:58:lfs.0 00010000:00010000:1.0:1788636420.049573:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.049590:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.049602:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636420.049822:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788636420.049917:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+54:10561:x1875520963793152:12345-192.168.203.57@tcp:58:lfs.0 Request processed in 463us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.049935:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 110 00000100:00100000:3.0:1788636420.056984:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.057240:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963793280 00000100:00100000:0.0:1788636420.057250:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963793280 00000100:00100000:0.0:1788636420.057298:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 111 00000100:00100000:0.0:1788636420.057309:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+54:10561:x1875520963793280:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636420.057328:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636420.057348:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556b7 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.057404:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.057416:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b7 expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.057436:0:5810:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.057449:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b7 expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.057482:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636420.057485:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636420.057489:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b7 expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.057496:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d600, rc 0) 00000100:00100000:0.0:1788636420.057557:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+55:10561:x1875520963793280:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 251us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636420.057564:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 111 00000040:00080000:0.0:1788636420.095287:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636420.095295:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636420.095355:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788636420.095361:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636420.095472:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610eaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976390400:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636420.095572:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636420.100355:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.100503:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963793408 00000100:00100000:2.0:1788636420.100513:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963793408 00000100:00100000:2.0:1788636420.100573:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 112 00000100:00100000:2.0:1788636420.100583:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+56:10562:x1875520963793408:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788636420.100614:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788636420.100711:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+56:10562:x1875520963793408:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 129us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636420.100738:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 112 00000100:00100000:0.0:1788636420.101183:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610eaa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976390400:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788636420.106167:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.106251:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963793536 00000100:00100000:1.0:1788636420.106262:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963793536 00000100:00100000:1.0:1788636420.106313:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 113 00000100:00100000:1.0:1788636420.106322:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+55:10562:x1875520963793536:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788636420.106401:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106417:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106429:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106500:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106509:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106516:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106537:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106545:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106551:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636420.106590:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788636420.106595:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636420.106608:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106619:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106625:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106631:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106647:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ae00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.106651:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106659:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106672:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:1.0:1788636420.106675:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.106680:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106687:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7a91 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106700:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106706:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106711:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106716:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.106719:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106726:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106744:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636420.106746:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.106749:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106755:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7a98 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106769:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106774:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106779:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106784:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.106787:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106792:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106830:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636420.106832:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.106835:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.106841:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7a9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.106921:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+55:10562:x1875520963793536:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 Request processed in 599us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.106929:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 113 00000100:00100000:2.0:1788636420.113991:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636420.114453:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963793792 00000100:00100000:3.0:1788636420.114462:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963793792 00000100:00100000:3.0:1788636420.114513:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 114 00000100:00100000:3.0:1788636420.114523:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+55:10562:x1875520963793792:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636420.114543:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636420.114611:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7aa6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556be expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.114705:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.114720:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.114732:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636420.114742:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788636420.114901:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.114909:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.114915:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.115038:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636420.115042:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.115051:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.115063:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:3.0:1788636420.115066:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636420.115070:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.115076:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7aad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.115238:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7aa6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556be expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.115249:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:3.0:1788636420.115251:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636420.115256:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7aa6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556be expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.115278:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997ca00, rc 0) 00000100:00100000:3.0:1788636420.115345:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+56:10562:x1875520963793792:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 823us (1362us total) trans 4294967397 rc 301/301 00000100:00100000:3.0:1788636420.115353:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 114 00000100:00100000:3.0:1788636420.118882:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.119247:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963793920 00000100:00100000:1.0:1788636420.119257:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963793920 00000100:00100000:1.0:1788636420.119309:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 115 00000100:00100000:1.0:1788636420.119319:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+56:10562:x1875520963793920:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788636420.119374:0:7975:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788636420.120160:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+56:10562:x1875520963793920:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 839us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.120169:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 115 00000100:00100000:2.0:1788636420.125901:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636420.126982:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963794176 00000100:00100000:3.0:1788636420.126992:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963794176 00000100:00100000:3.0:1788636420.127059:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 116 00000100:00100000:3.0:1788636420.127069:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+56:10562:x1875520963794176:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636420.127089:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636420.127092:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788636420.127302:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa7a4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556a2 expref: 56 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.127322:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:3.0:1788636420.127328:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636420.127342:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7abb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556c5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788636420.127711:0:5812:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788636420.128686:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7ac2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.128702:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.128712:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7ac2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.128791:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7abb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556c5 expref: 58 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.128839:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7ac2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556c5 expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.128857:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd42a85600) 00010000:00010000:3.0:1788636420.128860:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636420.128863:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636420.129281:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+57:10562:x1875520963794176:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 2212us (3388us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788636420.129290:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 116 00000100:00100000:2.0:1788636420.133597:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.133791:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963794432 00000100:00100000:1.0:1788636420.133828:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963794432 00000100:00100000:1.0:1788636420.133894:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 117 00000100:00100000:1.0:1788636420.133904:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+57:10562:x1875520963794432:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788636420.133962:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636420.133991:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7ac2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556c5 expref: 57 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134025:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd42a85600) 00010000:00010000:1.0:1788636420.134036:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636420.134058:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134071:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134102:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134158:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134166:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134174:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134240:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134248:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134254:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134259:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.134263:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134270:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134279:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:1.0:1788636420.134282:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.134286:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134461:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a200/0xa6aa59fb12fa7ad0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134473:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134478:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134483:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134487:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.134490:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134495:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134503:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x42308a70 (ffff9cfd5a43c700) 00010000:00010000:1.0:1788636420.134505:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.134508:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.134512:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7ad7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x42308a70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.134623:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+56:10562:x1875520963794432:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 720us (1035us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788636420.134630:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 117 00000100:00100000:0.0:1788636420.138105:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.138353:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963794560 00000100:00100000:1.0:1788636420.138362:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963794560 00000100:00100000:1.0:1788636420.138445:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 118 00000100:00100000:1.0:1788636420.138454:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+56:10562:x1875520963794560:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636420.138472:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636420.138494:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7ade lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556cc expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.138527:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.138541:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.138551:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.138647:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa7ade lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 58 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.138666:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.138674:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:1.0:1788636420.138677:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788636420.138681:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196b400, rc 0) 00000100:00100000:1.0:1788636420.138745:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+57:10562:x1875520963794560:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 292us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.138752:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 118 00000100:00100000:2.0:1788636420.142646:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.143049:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963794816 00000100:00100000:0.0:1788636420.143058:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963794816 00000100:00100000:0.0:1788636420.143125:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 119 00000100:00100000:0.0:1788636420.143135:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+57:10562:x1875520963794816:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788636420.143212:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.143229:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.143253:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788636420.143596:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1788636420.143682:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005e52c8a8 reply state 0000000060fdbef2 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.143692:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788636420.143787:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+59:10562:x1875520963794816:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 652us (1148us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788636420.143811:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 119 00010000:00010000:0.0:1788636420.146899:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.146914:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.146921:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.146927:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191de00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636420.146932:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.146939:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.146955:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:0.0:1788636420.146958:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788636420.146963:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.146986:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7aec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.148091:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.148398:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963794944 00000100:00100000:0.0:1788636420.148408:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963794944 00000100:00100000:1.0:1788636420.148666:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 120 00000100:00100000:1.0:1788636420.148679:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+58:10562:x1875520963794944:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636420.148704:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636420.148724:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556d3 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.148781:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.148936:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.148959:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:1.0:1788636420.148963:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636420.148966:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196b200, rc 0) 00000100:00100000:1.0:1788636420.149041:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+59:10562:x1875520963794944:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 364us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.149048:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 120 00000100:00100000:2.0:1788636420.151752:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.151860:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963795072 00000100:00100000:1.0:1788636420.151869:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963795072 00000100:00100000:1.0:1788636420.151933:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:1.0:1788636420.151944:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963795072:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788636420.152251:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636420.152429:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2362:x1875520963795072:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 487us (684us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788636420.152437:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:0.0:1788636420.154870:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.155025:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963795328 00000100:00100000:1.0:1788636420.155047:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963795328 00000100:00100000:1.0:1788636420.155102:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:1.0:1788636420.155113:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+59:10562:x1875520963795328:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788636420.155546:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+60:10562:x1875520963795328:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 434us (682us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788636420.155554:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:2.0:1788636420.158485:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.158585:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963795584 00000100:00100000:1.0:1788636420.158595:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963795584 00000100:00100000:1.0:1788636420.158678:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 121 00000100:00100000:1.0:1788636420.158689:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+60:10562:x1875520963795584:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788636420.158883:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+60:10562:x1875520963795584:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 196us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.158891:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 121 00000100:00100000:2.0:1788636420.164079:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.164479:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963795712 00000100:00100000:0.0:1788636420.164489:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963795712 00000100:00100000:0.0:1788636420.164588:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 122 00000100:00100000:0.0:1788636420.164599:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+60:10562:x1875520963795712:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636420.164617:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636420.164638:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7afa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556da expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.164707:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7b01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.164721:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.164733:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636420.164770:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636420.164789:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7b01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.164836:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7afa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556da expref: 62 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.164885:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7b01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556da expref: 61 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.164893:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:0.0:1788636420.164896:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788636420.164899:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191de00, rc 0) 00000100:00100000:0.0:1788636420.165007:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+61:10562:x1875520963795712:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 401us (927us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636420.165014:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 122 00000100:00100000:3.0:1788636420.168290:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.168549:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963795840 00000100:00100000:2.0:1788636420.168559:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963795840 00000100:00100000:2.0:1788636420.168616:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:2.0:1788636420.168626:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963795840:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636420.168644:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636420.168665:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556e1 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636420.168697:0:6963:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6d04, blocks: 0x1 00010000:00010000:2.0:1788636420.168716:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=289s v=(0 0) 00010000:00010000:2.0:1788636420.168720:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636420.168730:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 10 pid: 6963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.168747:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 10 pid: 6963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.168781:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb000, rc 0) 00000100:00100000:2.0:1788636420.168955:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+10:2363:x1875520963795840:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 329us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636420.168963:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:2.0:1788636420.173045:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.173552:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963796096 00000100:00100000:0.0:1788636420.173560:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963796096 00000100:00100000:0.0:1788636420.173617:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 123 00000100:00100000:0.0:1788636420.173627:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+61:10562:x1875520963796096:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788636420.173741:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+61:10562:x1875520963796096:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 115us (704us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636420.173748:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 123 00000100:00100000:1.0:1788636420.178012:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.178087:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963796224 00000100:00100000:0.0:1788636420.178095:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963796224 00000100:00100000:0.0:1788636420.178257:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:0.0:1788636420.178268:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+10:10562:x1875520963796224:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636420.178287:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636420.178305:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556e8 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.178338:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 11 pid: 6963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.178360:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636420.178364:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636420.178369:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.178403:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 11 pid: 6963 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.178417:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 11 pid: 6963 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.178431:0:6662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75972680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976390528:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636420.178561:0:6662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636420.181750:0:6662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75972680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976390528:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636420.181815:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.181838:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d000, rc 0) 00000100:00100000:2.0:1788636420.181905:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+11:10562:x1875520963796224:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 3638us (3912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636420.181915:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:2.0:1788636420.184785:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.185208:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963796352 00000100:00100000:1.0:1788636420.185218:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963796352 00010000:00010000:1.0:1788636420.185258:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 11 pid: 6963 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.185328:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00100000:1.0:1788636420.185338:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+11:2363:x1875520963796352:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636420.185354:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636420.185377:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 11 pid: 6963 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.185410:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 11 pid: 6963 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.185433:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010b32b77/0xa6aa59fb12fa7b08 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e1 expref: 11 pid: 6963 timeout: 389 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.185448:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636420.185453:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636420.185461:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 10 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.185470:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 10 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.185507:0:5796:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 10 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.185520:0:5796:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1875520976390656:192.168.203.57@tcp:105: 00000100:00100000:1.0:1788636420.185591:0:5796:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd58305480 going to sleep for 11 seconds 00000100:00100000:1.0:1788636420.189382:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.189838:0:5796:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5796:1875520976390656:192.168.203.57@tcp:105: 00010000:00010000:0.0:1788636420.189873:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636420.189927:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699a8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+10:2363:x1875520963796352:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 4590us (5157us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636420.189939:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00100000:3.0:1788636420.190274:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963796480 00000100:00100000:3.0:1788636420.190282:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963796480 00002000:00100000:3.0:1788636420.190326:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cfd7f92ed80 x1875520963796480/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:661/0 lens 504/0 e 0 to 0 dl 1788636431 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788636420.190336:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd7f92ed80 with x1875520963796480 ext(0->12) 00002000:00010000:3.0:1788636420.190341:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd7f92ed80 00000100:00100000:3.0:1788636420.190372:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:3.0:1788636420.190381:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:38630149-ece4-4de3-88b1-a62e16a39489+10:2363:x1875520963796480:12345-192.168.203.57@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788636420.190764:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:38630149-ece4-4de3-88b1-a62e16a39489+12:2363:x1875520963796480:12345-192.168.203.57@tcp:4:lhsmtool_posix.0 Request processed in 383us (1389us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788636420.190771:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 3 00002000:00100000:3.0:1788636420.190783:0:6667:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cfd7f92ed80 x1875520963796480/t4294967309(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:661/0 lens 504/448 e 0 to 0 dl 1788636431 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788636420.190793:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd7f92ed80 with x1875520963796480 ext(0->12) 00002000:00010000:3.0:1788636420.190823:0:6667:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd7f92ed80 00000100:00100000:1.0:1788636420.194600:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.194675:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963796608 00000100:00100000:2.0:1788636420.194684:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963796608 00000100:00100000:2.0:1788636420.194745:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 124 00000100:00100000:2.0:1788636420.194755:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+61:10562:x1875520963796608:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788636420.231702:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000001:00080000:3.0:1788636420.231750:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788636420.231767:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788636420.231827:0:5832:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cfd47efa480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788636420.231832:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd450dad00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd47efa180 00000020:00080000:3.0:1788636420.231836:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd450da100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd69bfc000 00000020:00080000:3.0:1788636420.232067:0:5832:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cfd51335b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788636420.232072:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd450da500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd51335000 00000020:00080000:3.0:1788636420.232075:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd450da000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd75826400 00000004:00080000:3.0:1788636420.232118:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788636420.232145:0:5832:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:3.0:1788636420.232158:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788636420.232362:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788636420.232465:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636420.232483:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976390784:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788636420.232547:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636420.232713:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+15:10562:x1875520963796608:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 Request processed in 37956us (38121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.232728:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 124 00000100:00100000:0.0:1788636420.232771:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976390912:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788636420.232830:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636420.232935:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976390784 00000100:00100000:1.0:1788636420.232942:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976390784 00000100:00100000:1.0:1788636420.232985:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976390912 00000100:00100000:1.0:1788636420.232989:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976390912 00000100:00100000:0.0:1788636420.233012:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788636420.233037:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788636420.233045:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976390912:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788636420.233065:0:6661:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1788636420.233097:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9c6d03, atime: 0x6a9c6d03, ctime: 0x6a9c6d03, blocks: 0x1 00000100:00100000:0.0:1788636420.233102:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976390784:12345-0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788636420.233114:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1788636420.233115:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:1.0:1788636420.233129:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=289s v=(0 0) 00010000:00010000:1.0:1788636420.233133:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636420.233139:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.233141:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.233154:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.233156:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.233162:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788636420.233164:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636420.233166:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.233168:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.233175:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.233193:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 11 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.233196:0:6661:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636420.233207:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 11 pid: 6659 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.233218:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75971c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1875520976391040:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636420.233255:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4d80 going to sleep for 11 seconds 00010000:00010000:2.0:1788636420.233341:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636420.233348:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.233356:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ae00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636420.233360:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.233375:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.233390:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.233397:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af86b797/0xa6aa59fb12fa7b16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.233412:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636420.233413:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636420.233415:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636420.233542:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636420.233546:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636420.234439:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976390912:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1391us (1604us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788636420.234457:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1788636420.234577:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd75971f80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788636420.234583:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976390912:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788636420.236595:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636420.236697:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.236777:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75971c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1875520976391040:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636420.236833:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.236953:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963796864 00000100:00100000:2.0:1788636420.236960:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963796864 00000100:00100000:1.0:1788636420.237028:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963796736 00000100:00100000:1.0:1788636420.237032:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963796736 00000100:00100000:2.0:1788636420.237056:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 43 00010000:00010000:1.0:1788636420.237057:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 13 pid: 6659 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.237064:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+13:2363:x1875520963796864:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788636420.237088:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 55 00000100:00100000:1.0:1788636420.237094:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+13:2362:x1875520963796736:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636420.237112:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636420.237119:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 13 pid: 6659 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.237132:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 13 pid: 6659 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.237152:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081cee2c7/0xa6aa59fb12fa78d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155647 expref: 13 pid: 6659 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.237166:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636420.237170:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636420.237176:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.237185:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.237232:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636420.237250:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.237267:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.237277:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.237285:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.237306:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788636420.237392:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+12:2362:x1875520963796736:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 297us (801us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.237398:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 55 00010000:00010000:2.0:1788636420.237933:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636420.237943:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.237951:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636420.237955:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.237963:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.237983:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.237990:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7b1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.238015:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636420.238017:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636420.238019:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636420.238702:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976390784:12345-0@lo:6:osp-syn-1-0.0 Request processed in 5678us (6150us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788636420.238711:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788636420.243090:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788636420.243102:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1788636420.243563:0:3280:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cfd75b9aa00 x1875520976390784/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788636436 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788636420.243577:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd75b9aa00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788636420.243595:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75b9aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976390784:0@lo:6:osp-syn-1-0.0 00000001:00080000:1.0:1788636420.292105:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788636420.292121:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788636420.292130:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:1.0:1788636420.292137:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:0.0:1788636420.292365:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963796864:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 Request processed in 55295us (55660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636420.292377:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 43 00000100:00100000:3.0:1788636420.296336:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.296450:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963797120 00000100:00100000:0.0:1788636420.296462:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963797120 00000100:00100000:0.0:1788636420.296533:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 125 00000100:00100000:0.0:1788636420.296543:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+15:10562:x1875520963797120:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788636420.296594:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636420.296620:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7b01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556da expref: 15 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.296639:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:0.0:1788636420.296657:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636420.296689:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.296701:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.296711:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636420.297316:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f47bb5ca reply state 000000006929c962 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.297328:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788636420.297913:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+16:10562:x1875520963797120:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 1367us (1581us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788636420.297922:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 125 00010000:00010000:1.0:1788636420.300283:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.300297:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.300305:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.300311:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.300316:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.300325:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.300341:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:1.0:1788636420.300344:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.300348:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.300372:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7b24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636420.304089:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.305968:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963797248 00000100:00100000:1.0:1788636420.305981:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963797248 00000100:00100000:1.0:1788636420.306052:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:1.0:1788636420.306061:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963797248:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788636420.306309:0:6662:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788636420.306314:0:6662:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788636420 00002000:00010000:1.0:1788636420.306316:0:6662:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788636419 00002000:00010000:1.0:1788636420.306318:0:6662:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788636420 -> 1788636420 00002000:00010000:1.0:1788636420.306320:0:6662:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788636420.306386:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:2360:x1875520963797248:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 324us (2304us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788636420.306394:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:3.0:1788636420.319689:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.320965:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963797504 00000100:00100000:1.0:1788636420.320978:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963797504 00000100:00100000:1.0:1788636420.321063:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 126 00000100:00100000:1.0:1788636420.321074:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+15:10562:x1875520963797504:12345-192.168.203.57@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788636420.321154:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.321173:0:7975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.321181:0:7975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.321241:0:7975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.321255:0:7975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 15 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.321270:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976391168:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636420.321363:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd587e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636420.327644:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976391168:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636420.327680:0:7975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636420.330294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.330653:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963797632 00000100:00100000:2.0:1788636420.330663:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963797632 00010000:00010000:2.0:1788636420.330703:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 16 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.330757:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 56 00000100:00100000:2.0:1788636420.330767:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+16:2363:x1875520963797632:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636420.330780:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636420.330788:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 16 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.330860:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 16 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.330883:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b400/0xa6aa59fb12fa7ae5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556cc expref: 16 pid: 5810 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.330899:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:2.0:1788636420.330904:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.330915:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.330922:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.330950:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636420.331005:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+15:2363:x1875520963797632:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 230us (712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636420.331013:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 56 00010000:00010000:1.0:1788636420.331031:0:7975:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.331042:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.331073:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.331081:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.331088:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.331093:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.331097:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.331113:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.331122:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:1.0:1788636420.331135:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788636420.331140:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.331146:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b2b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.331192:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+14:10562:x1875520963797504:12345-192.168.203.57@tcp:55:lhsmtool_posix.0 Request processed in 10120us (11511us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788636420.331200:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 126 00000100:00100000:0.0:1788636420.334867:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.334950:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963797760 00000100:00100000:1.0:1788636420.334959:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963797760 00000100:00100000:1.0:1788636420.335008:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:1.0:1788636420.335018:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963797760:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788636420.335062:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.335083:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.335093:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636420.335097:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636420.335102:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.335146:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 7 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.335161:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 7 pid: 6662 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.335175:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1875520976391296:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636420.335255:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd587e5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636420.339966:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.340233:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963797888 00000100:00100000:0.0:1788636420.340242:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963797888 00000100:00100000:1.0:1788636420.340257:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6659:1875520976391296:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636420.340284:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 8 pid: 6662 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.340286:0:6659:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.340356:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 57 00000100:00100000:0.0:1788636420.340366:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963797888:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636420.340403:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636420.340428:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 8 pid: 6662 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.340463:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 8 pid: 6662 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.340486:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a6157d87/0xa6aa59fb12fa7b0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351556e8 expref: 8 pid: 6662 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.340502:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636420.340506:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636420.340513:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.340522:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.340552:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636420.340569:0:6659:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.340581:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.340614:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963797888:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 248us (660us total) trans 0 rc 0/0 00010000:00010000:1.0:1788636420.340620:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.340625:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 57 00010000:00010000:1.0:1788636420.340635:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.340656:0:6659:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.340663:0:6659:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196aa00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636420.340667:0:6659:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.340675:0:6659:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.340688:0:6659:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.340695:0:6659:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7b32 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.340742:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963797760:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 Request processed in 5725us (5884us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.340750:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:3.0:1788636420.343935:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.344016:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963798144 00000100:00100000:1.0:1788636420.344026:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963798144 00000100:00100000:1.0:1788636420.344135:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 127 00000100:00100000:1.0:1788636420.344146:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:10562:x1875520963798144:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788636420.344234:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.344269:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.344283:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.344473:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.344485:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.344493:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.344525:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.344539:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 15 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.344553:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976391424:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636420.344636:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd587e5900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636420.349374:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976391424:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636420.349406:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636420.354149:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636420.355031:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963798272 00000100:00100000:1.0:1788636420.355052:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963798272 00010000:00010000:0.0:1788636420.355159:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 16 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.355256:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:0.0:1788636420.355266:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+16:2362:x1875520963798272:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636420.355279:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636420.355286:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 16 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.355305:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 16 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.355327:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa7af3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556d3 expref: 16 pid: 5811 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.355342:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:0.0:1788636420.355347:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.355356:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.355363:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.355390:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636420.355438:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+15:2362:x1875520963798272:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 175us (1299us total) trans 0 rc 0/0 00010000:00010000:1.0:1788636420.355580:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.355588:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636420.355768:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788636420.355942:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788636420.355979:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788636420.356055:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1875520976391552:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788636420.356100:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636420.356129:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eeb840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636420.356149:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976391552 00000100:00100000:1.0:1788636420.356154:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976391552 00000100:00100000:1.0:1788636420.356186:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788636420.356194:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875520976391552:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788636420.356362:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875520976391552:12345-0@lo:1000:mdt00_000.0 Request processed in 169us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.356368:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788636420.356396:0:5810:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788636420.356400:0:5810:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd75b9aa00, transno 4294967310 00000100:00100000:1.0:1788636420.356409:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1875520976391552:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788636420.356842:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788636420.357081:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:1.0:1788636420.358353:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1875520976391680:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788636420.358433:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636420.358460:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eebb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636420.358572:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976391680 00000100:00100000:2.0:1788636420.358579:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976391680 00000100:00100000:2.0:1788636420.358633:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636420.358643:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875520976391680:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788636420.359479:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5810:x1875520976391680:12345-0@lo:1000:mdt00_000.0 Request processed in 834us (1043us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788636420.359489:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636420.359570:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1875520976391680:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788636420.359671:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.359681:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.359689:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.359696:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.359700:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.359708:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360048:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd5a43c100) 00010000:00010000:1.0:1788636420.360052:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636420.360057:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360064:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360092:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360098:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360219:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360236:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196bc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.360239:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360245:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360253:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636420.360256:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636420.360262:0:5810:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b7 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360273:0:5810:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b7 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360282:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b7 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.360311:0:5810:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b7 expref: 18 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636420.360324:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc4222c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976391808:192.168.203.57@tcp:105: 00000100:00100000:1.0:1788636420.360432:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd587e5900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636420.365165:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.365702:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963798400 00000100:00100000:2.0:1788636420.365712:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963798400 00000100:00100000:2.0:1788636420.365772:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 31 00000100:00100000:2.0:1788636420.365782:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:10561:x1875520963798400:12345-192.168.203.57@tcp:49:lfs.0 00000100:00100000:1.0:1788636420.365941:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc4222c000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976391808:192.168.203.57@tcp:105: 00010000:00010000:1.0:1788636420.365967:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.365994:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7a83 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366033:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366047:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366057:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366066:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366072:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366078:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366084:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196aa00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.366087:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366095:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366106:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636420.366110:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636420.366114:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366192:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7b47 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366204:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366210:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366215:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366221:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636420.366224:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366230:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366239:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636420.366241:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788636420.366244:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636420.366248:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7b39 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.367096:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:10561:x1875520963798400:12345-192.168.203.57@tcp:49:lfs.0 Request processed in 1309us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636420.367114:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 31 00000040:00080000:0.0:1788636420.370050:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636420.370058:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636420.370575:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788636420.370585:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636420.370711:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.370857:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963798656 00000100:00100000:2.0:1788636420.370865:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963798656 00000100:00100000:2.0:1788636420.370920:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 128 00000100:00100000:2.0:1788636420.370930:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+19:10561:x1875520963798656:12345-192.168.203.57@tcp:58:lfs.0 00000100:00100000:1.0:1788636420.371499:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:10562:x1875520963798144:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 27351us (27569us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788636420.371509:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 127 00000020:00080000:1.0:1788636420.371523:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788636420.371870:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1788636420.371930:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+18:10561:x1875520963798656:12345-192.168.203.57@tcp:58:lfs.0 Request processed in 1000us (1222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636420.371937:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 128 00000100:00100000:3.0:1788636420.386222:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636420.386366:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963798912 00000100:00100000:0.0:1788636420.386376:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963798912 00000100:00100000:0.0:1788636420.386442:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 32 00000100:00100000:0.0:1788636420.386452:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd507d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+18:10562:x1875520963798912:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788636420.387373:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788636420.387475:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788636420.387521:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.387539:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.387550:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.387560:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.387566:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.387572:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636420.388744:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788636420.388884:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd507d5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+20:10562:x1875520963798912:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 2430us (2667us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788636420.388895:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 32 00000020:00080000:0.0:1788636420.388901:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788636420.389516:0:11147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636420.389524:0:11147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.389534:0:11147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c400 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636420.389538:0:11147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.389547:0:11147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.389562:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cfd500ebd00) 00010000:00010000:3.0:1788636420.389565:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788636420.389570:0:11147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.389576:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7b4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.389593:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636420.389594:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636420.389596:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636420.429183:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.429345:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963799040 00000100:00100000:2.0:1788636420.429354:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963799040 00000100:00100000:2.0:1788636420.429417:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 129 00000100:00100000:2.0:1788636420.429429:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+20:10564:x1875520963799040:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636420.429453:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636420.429475:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556ef expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.429542:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.429557:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.429581:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.429596:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.429616:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.429624:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.430053:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.430065:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.430075:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.430107:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.430312:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 21 pid: 5812 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.430330:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976391936:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636420.430430:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd699390c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636420.436400:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818df800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976391936:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636420.436431:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636420.442601:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636420.442758:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963799296 00000100:00100000:2.0:1788636420.442766:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963799296 00000100:00100000:2.0:1788636420.442841:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00100000:2.0:1788636420.442852:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+22:5598:x1875520963799296:12345-192.168.203.57@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788636420.443088:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+23:5598:x1875520963799296:12345-192.168.203.57@tcp:35:ldlm_bl.0 Request processed in 237us (495us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1788636420.443096:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00100000:2.0:1788636420.452753:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636420.454465:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963799424 00000100:00100000:3.0:1788636420.454495:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963799424 00010000:00010000:2.0:1788636420.454636:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 23 pid: 5812 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636420.454740:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00100000:2.0:1788636420.454750:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+23:2362:x1875520963799424:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636420.454765:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636420.454773:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 23 pid: 5812 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.454787:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 23 pid: 5812 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.454827:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7a75 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351556b0 expref: 23 pid: 5812 timeout: 389 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.454843:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:2.0:1788636420.454848:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.454869:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.454876:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636420.454910:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636420.454976:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+22:2362:x1875520963799424:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 227us (2232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636420.454983:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 59 00010000:00010000:3.0:1788636420.455044:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455052:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636420.455093:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788636420.455097:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636420.455134:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455147:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455155:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455162:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455168:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455173:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636420.455177:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455184:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455192:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:3.0:1788636420.455195:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636420.455205:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455212:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7b5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455225:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455230:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455235:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455240:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636420.455243:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455248:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455254:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cfd62575f00) 00010000:00010000:3.0:1788636420.455256:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636420.455259:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455265:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7b63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455296:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556ef expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455323:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556ef expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636420.455330:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:3.0:1788636420.455332:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636420.455334:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eba00, rc 0) 00000100:00100000:3.0:1788636420.455361:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+21:10564:x1875520963799040:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 25935us (26187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636420.455369:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 129 00010000:00010000:1.0:1788636420.735287:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636420.736380:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636420.741228:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976392064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636420.741307:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636420.746007:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976392064 00000100:00100000:1.0:1788636420.746022:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976392064 00000100:00100000:1.0:1788636420.746077:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788636420.746088:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976392064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636420.746123:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636420.746197:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976392064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (4889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636420.746204:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788636420.748698:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976392064:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788636421.241548:0:12090:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636421.241557:0:12090:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636421.241605:0:12090:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788636421.241610:0:12090:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788636421.377712:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636421.377721:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636421.377763:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788636421.377769:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636421.377970:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75970e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976392192:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636421.378066:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636421.384674:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75970e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976392192:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636421.387338:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636421.387379:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963799552 00000100:00100000:0.0:1788636421.387388:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963799552 00000100:00100000:0.0:1788636421.387448:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 130 00000100:00100000:0.0:1788636421.387458:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+21:10576:x1875520963799552:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788636421.387491:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788636421.387586:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+21:10576:x1875520963799552:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 129us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636421.387594:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 130 00000100:00080000:0.0:1788636421.387616:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636421.392502:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636421.395872:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963799808 00000100:00100000:1.0:1788636421.395883:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963799808 00000100:00100000:1.0:1788636421.396033:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 131 00000100:00100000:1.0:1788636421.396044:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+21:10576:x1875520963799808:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636421.396065:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636421.396085:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7b71 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556f6 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636421.396177:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636421.396191:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636421.396205:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636421.396216:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788636421.396333:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7b71 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556f6 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636421.396369:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556f6 expref: 23 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636421.396378:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:1.0:1788636421.396381:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636421.396384:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a800, rc 0) 00000100:00100000:1.0:1788636421.396452:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+23:10576:x1875520963799808:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 411us (3959us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1788636421.396459:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 131 00000100:00100000:0.0:1788636421.402207:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636421.402285:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963800064 00000100:00100000:2.0:1788636421.402297:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963800064 00000100:00100000:2.0:1788636421.402349:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 132 00000100:00100000:2.0:1788636421.402360:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+23:10576:x1875520963800064:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788636421.402446:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402463:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402475:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402661:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402680:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402687:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402693:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636421.402696:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402703:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402715:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:2.0:1788636421.402718:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636421.402722:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636421.402728:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7b86 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636421.402885:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:10576:x1875520963800064:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 523us (683us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788636421.402893:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 132 00000040:00080000:3.0:1788636421.403042:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636421.403046:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636421.403578:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788636421.403587:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788636421.404652:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636421.404724:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963800192 00000100:00100000:0.0:1788636421.404731:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963800192 00000100:00100000:0.0:1788636421.405456:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:0.0:1788636421.405469:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+24:2362:x1875520963800192:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636421.405486:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636421.405511:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7b78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556f6 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636421.405540:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636421.405545:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636421.405646:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+23:2362:x1875520963800192:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 180us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636421.405654:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:1.0:1788636421.408661:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636421.408722:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963800448 00000100:00100000:2.0:1788636421.408730:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963800448 00000100:00100000:2.0:1788636421.408774:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:2.0:1788636421.408784:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+23:10576:x1875520963800448:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788636421.409093:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+24:10576:x1875520963800448:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 309us (439us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788636421.409102:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:1.0:1788636421.707051:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636421.707112:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636421.707142:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636421.707257:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963800704 00000100:00100000:2.0:1788636421.707264:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963800832 00000100:00100000:0.0:1788636421.707267:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963800704 00000100:00100000:2.0:1788636421.707270:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963800832 00000100:00100000:3.0:1788636421.707350:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963800576 00000100:00100000:3.0:1788636421.707354:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963800576 00000100:00100000:3.0:1788636421.707386:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 285 00000100:00100000:3.0:1788636421.707394:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963800576:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636421.707457:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963800576:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 63us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636421.707477:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 285 00000100:00080000:1.0:1788636421.707649:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636421.708649:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 76 00000100:00100000:2.0:1788636421.708665:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963800832:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636421.708722:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963800832:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 64us (1579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636421.708733:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 76 00000100:00100000:2.0:1788636421.708751:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 77 00000100:00100000:2.0:1788636421.708759:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963800704:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636421.709746:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963800704:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 981us (2698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636421.709758:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 77 00000100:00100000:3.0:1788636421.712761:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636421.715204:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963800960 00000100:00100000:2.0:1788636421.715216:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963800960 00000100:00080000:1.0:1788636421.715308:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636421.715352:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 131 00000100:00100000:2.0:1788636421.715362:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963800960:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636421.715444:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963800960:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 84us (2690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636421.715450:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 131 00010000:00010000:2.0:1788636421.759351:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636422.784299:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788636423.053835:0:12141:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636423.053842:0:12141:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636423.053887:0:12141:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788636423.053893:0:12141:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636423.257497:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636423.258495:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963801216 00000100:00100000:2.0:1788636423.258514:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963801216 00000100:00100000:2.0:1788636423.258595:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 133 00000100:00100000:2.0:1788636423.258607:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:10596:x1875520963801216:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636423.258647:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636423.258669:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7b8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351556fd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636423.258777:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eac00/0xa6aa59fb12fa7b94 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636423.258793:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eac00/0xa6aa59fb12fa7b94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636423.258829:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eac00/0xa6aa59fb12fa7b94 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636423.258841:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788636423.258968:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7b8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556fd expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636423.258994:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eac00/0xa6aa59fb12fa7b94 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556fd expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636423.259004:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:2.0:1788636423.259007:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788636423.259010:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eac00, rc 0) 00000100:00100000:2.0:1788636423.259079:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+26:10596:x1875520963801216:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 475us (1591us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1788636423.259086:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 133 00000100:00080000:1.0:1788636423.260704:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636423.269457:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636423.269613:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963801344 00000100:00100000:3.0:1788636423.269623:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963801344 00000100:00100000:3.0:1788636423.269684:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 134 00000100:00100000:3.0:1788636423.269819:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+26:10596:x1875520963801344:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:3.0:1788636423.269892:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.269909:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.269921:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.269948:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.269954:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.269960:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.269966:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636423.269970:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.269990:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.270018:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:3.0:1788636423.270021:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636423.270027:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636423.270033:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ba2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636423.270125:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75865180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+26:10596:x1875520963801344:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 433us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636423.270133:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 134 00000100:00100000:3.0:1788636423.441316:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636423.441523:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963801472 00000100:00100000:1.0:1788636423.441534:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963801472 00000100:00100000:1.0:1788636423.441617:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:1.0:1788636423.441629:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963801472:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:1.0:1788636423.441663:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:0.0:1788636423.441680:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788636423.441685:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa7ba9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155704 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636423.441714:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c6d04, atime: 0x6a9c6d03, ctime: 0x6a9c6d04, blocks: 0xb 00010000:00010000:1.0:1788636423.441732:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=292s v=(0 0) 00010000:00010000:1.0:1788636423.441736:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636423.441746:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa7ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155704 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636423.441844:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa7ba9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155704 expref: 7 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636423.441859:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196be00, rc 0) 00000100:00100000:1.0:1788636423.441929:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2360:x1875520963801472:12345-192.168.203.57@tcp:101:cat.0 Request processed in 303us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636423.441936:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:2.0:1788636423.462194:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636423.462360:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963801600 00000100:00100000:3.0:1788636423.462371:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963801600 00002000:00100000:3.0:1788636423.462418:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9cfd756a5880 x1875520963801600/t0(0) o3->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:664/0 lens 488/0 e 0 to 0 dl 1788636434 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788636423.462430:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd756a5880 with x1875520963801600 ext(0->4095) 00002000:00010000:3.0:1788636423.462435:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd756a5880 00000100:00100000:3.0:1788636423.462469:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:3.0:1788636423.462479:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963801600:12345-192.168.203.57@tcp:3:cat.0 00000100:00100000:3.0:1788636423.462708:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963801600:12345-192.168.203.57@tcp:3:cat.0 Request processed in 230us (523us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788636423.462715:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 4 00002000:00100000:3.0:1788636423.462722:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9cfd756a5880 x1875520963801600/t0(0) o3->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:664/0 lens 488/4536 e 0 to 0 dl 1788636434 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788636423.462731:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd756a5880 with x1875520963801600 ext(0->4095) 00002000:00010000:3.0:1788636423.462746:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd756a5880 00000100:00100000:3.0:1788636423.807193:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976392448:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807261:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636423.807325:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976392960:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807370:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636423.807405:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788636423.807412:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976392320:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807438:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636423.807460:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976392832:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807481:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636423.807506:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976392576:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807527:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636423.807546:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636423.807551:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976392704:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807570:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636423.807597:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976392960 00000100:00100000:3.0:1788636423.807604:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976392960 00000100:00100000:3.0:1788636423.807654:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976392704 00000100:00100000:3.0:1788636423.807658:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976392704 00000100:00100000:3.0:1788636423.807680:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788636423.807701:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1875520976392960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807751:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3281:x1875520976392960:12345-0@lo:400:kworker.0 Request processed in 64us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636423.807771:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788636423.807788:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788636423.807824:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976392704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807867:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976392704:12345-0@lo:400:kworker.0 Request processed in 73us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636423.807873:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788636423.807891:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976392320 00000100:00100000:3.0:1788636423.807894:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976392320 00000100:00100000:3.0:1788636423.807917:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788636423.807923:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976392320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.807952:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3281:x1875520976392320:12345-0@lo:400:kworker.0 Request processed in 28us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636423.807957:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1788636423.808007:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976392448 00000100:00100000:3.0:1788636423.808011:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976392448 00000100:00100000:3.0:1788636423.808033:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976392832 00000100:00100000:3.0:1788636423.808036:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976392832 00000100:00100000:3.0:1788636423.808049:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976392576 00000100:00100000:3.0:1788636423.808051:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976392576 00000100:00100000:3.0:1788636423.808066:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788636423.808071:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976392448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.808101:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976392448:12345-0@lo:400:kworker.0 Request processed in 30us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636423.808107:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788636423.808118:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788636423.808124:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976392832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.808149:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976392832:12345-0@lo:400:kworker.0 Request processed in 25us (667us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636423.808154:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788636423.808164:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788636423.808178:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976392576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.808207:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976392576:12345-0@lo:400:kworker.0 Request processed in 31us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636423.808213:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00080000:3.0:1788636423.808231:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636423.808235:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636423.808237:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636423.808264:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976392704:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.808277:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976392576:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.808303:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:1196c107-eaca-4490-96fc-d60d67da8edc:3281:1875520976392320:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.808313:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976392832:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.808321:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976392448:0@lo:400:kworker.0 00000100:00100000:3.0:1788636423.808329:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976392960:0@lo:400:kworker.0 00010000:00010000:1.0:1788636423.810472:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788636424.320100:0:7974:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 293344300941ns, next at 294344297550ns, rc = 0 00000100:00100000:0.0:1788636424.320698:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976393088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636424.320852:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636424.321089:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976393088 00000100:00100000:1.0:1788636424.321099:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976393088 00000100:00100000:1.0:1788636424.321166:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636424.321178:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976393088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636424.321224:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636424.321294:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976393088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636424.321329:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788636424.321407:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75865f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976393088:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788636424.454999:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788636424.455029:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1788636424.455043:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:2.0:1788636424.833466:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788636425.373951:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:1.0:1788636425.373976:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:0.0:1788636425.424187:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967408 is committed 00000004:00080000:0.0:1788636425.424208:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000001:00080000:0.0:1788636425.424227:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000020:00080000:0.0:1788636425.424238:0:5832:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cfd47eeb180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788636425.424243:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd450dae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd47eeb840 00000020:00080000:0.0:1788636425.424247:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd450dac00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd818ed400 00000001:00080000:0.0:1788636425.424266:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:0.0:1788636425.424282:0:5832:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1788636425.424294:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788636425.424484:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:3.0:1788636425.424713:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636425.424733:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976393216:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788636425.424834:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636425.424900:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976393216 00000100:00100000:3.0:1788636425.424907:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976393216 00000100:00100000:3.0:1788636425.424953:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636425.424973:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976393216:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788636425.425161:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788636425.425164:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788636420 -> 1788636420 00002000:00010000:3.0:1788636425.425166:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1788636419 -> 1788636419 00002000:00010000:3.0:1788636425.425168:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788636420 -> 1788636420 00002000:00010000:3.0:1788636425.425183:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788636425.425223:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976393216:12345-0@lo:2:osp-syn-1-0.0 Request processed in 262us (388us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1788636425.425230:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1788636425.425250:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636425.425279:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788636425.425284:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788636425.425303:0:3282:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cfd7fe3d500 x1875520976393216/t4294967313(4294967313) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788636441 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788636425.425315:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd7fe3d500/2, rc 0, transno 4294967313 00000100:00100000:3.0:1788636425.425320:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976393216:0@lo:2:osp-syn-1-0.0 00010000:00010000:1.0:1788636425.855297:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636425.855821:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976393344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636425.855895:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636425.856001:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976393344 00000100:00100000:1.0:1788636425.856019:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976393344 00000100:00080000:3.0:1788636425.856089:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636425.856093:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788636425.856104:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976393344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636425.856147:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636425.856226:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976393344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636425.856233:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788636425.856376:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1788636425.856382:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:0.0:1788636425.856399:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd75971f80, transno 4294967304 00000100:00100000:0.0:1788636425.856426:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976393344:0@lo:13:osp-pre-0-0.0 00000040:00080000:3.0:1788636426.559788:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636426.559828:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636426.559876:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788636426.559884:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636426.825770:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636426.825848:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636426.825876:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636426.825896:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636426.825919:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636426.825964:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963801984 00000100:00100000:3.0:1788636426.825974:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963801984 00000100:00100000:3.0:1788636426.826028:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963802112 00000100:00100000:3.0:1788636426.826031:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963802112 00000100:00100000:3.0:1788636426.826055:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 80 00000100:00100000:3.0:1788636426.826089:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963801984:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636426.826168:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2360:x1875520963801984:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 93us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636426.826176:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 80 00000100:00100000:3.0:1788636426.826194:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 81 00000100:00100000:3.0:1788636426.826201:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963802112:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636426.826227:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2360:x1875520963802112:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 27us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636426.826233:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 81 00000100:00100000:3.0:1788636426.826251:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963802240 00000100:00100000:3.0:1788636426.826255:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963802240 00000100:00100000:3.0:1788636426.826282:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963801856 00000100:00100000:3.0:1788636426.826286:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963801856 00000100:00100000:3.0:1788636426.826306:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 135 00000100:00100000:3.0:1788636426.826312:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963802240:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636426.826340:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2360:x1875520963802240:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 28us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636426.826346:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 135 00000100:00100000:3.0:1788636426.826357:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 136 00000100:00100000:3.0:1788636426.826363:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+13:2360:x1875520963801856:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636426.826386:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+13:2360:x1875520963801856:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 23us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636426.826392:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 136 00000100:00080000:3.0:1788636426.826413:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636426.826423:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636426.826425:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636426.826711:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963801728 00000100:00100000:0.0:1788636426.826721:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963801728 00000100:00100000:0.0:1788636426.826760:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 287 00000100:00100000:0.0:1788636426.826767:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963801728:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636426.826821:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963801728:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 55us (1062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636426.826828:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 287 00010000:00010000:1.0:1788636426.880829:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636427.903558:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636427.962921:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636427.963482:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963802368 00000100:00100000:0.0:1788636427.963493:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963802368 00000100:00100000:0.0:1788636427.963556:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 135 00000100:00100000:0.0:1788636427.963566:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+13:10241:x1875520963802368:12345-192.168.203.57@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788636427.963670:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+13:10241:x1875520963802368:12345-192.168.203.57@tcp:60:lhsmtool_posix.0 Request processed in 105us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636427.963680:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 135 00000100:00100000:0.0:1788636427.967440:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636427.967514:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963802624 00000100:00100000:3.0:1788636427.967526:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963802624 00000100:00100000:3.0:1788636427.967587:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 35 00000100:00100000:3.0:1788636427.967598:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+13:10241:x1875520963802624:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788636427.968327:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:10241:x1875520963802624:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 728us (894us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1788636427.968336:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 35 00000100:00100000:2.0:1788636428.194322:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636428.194404:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963802752 00000100:00100000:3.0:1788636428.194414:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963802752 00000100:00080000:0.0:1788636428.194542:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636428.198812:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 136 00000100:00100000:3.0:1788636428.198838:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:11048:x1875520963802752:12345-192.168.203.57@tcp:101:lsof.0 00010000:00010000:3.0:1788636428.199588:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636428.199616:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bb0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515570b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636428.199684:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636428.199698:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636428.199711:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636428.199744:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788636428.199748:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636428.199835:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636428.200101:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bb0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 7 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636428.200123:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 6 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636428.200132:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636428.200135:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636428.200139:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d600, rc 0) 00000100:00100000:3.0:1788636428.200215:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75cfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+6:11048:x1875520963802752:12345-192.168.203.57@tcp:101:lsof.0 Request processed in 1389us (5902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636428.200223:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 136 00000100:00100000:3.0:1788636428.927193:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976393728:0@lo:400:kworker.0 00000100:00100000:3.0:1788636428.927266:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636428.927327:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788636428.927333:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976393600:0@lo:400:kworker.0 00000100:00100000:3.0:1788636428.927472:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636428.927494:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976394112:0@lo:400:kworker.0 00000100:00100000:3.0:1788636428.927519:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636428.927557:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976394112 00000100:00100000:3.0:1788636428.927565:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976394112 00000100:00100000:0.0:1788636428.927644:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976393856:0@lo:400:kworker.0 00000100:00100000:0.0:1788636428.927673:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636428.927695:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788636428.927700:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976393472:0@lo:400:kworker.0 00000100:00100000:0.0:1788636428.927726:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636428.927747:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976393984:0@lo:400:kworker.0 00000100:00100000:1.0:1788636428.927878:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976393472 00000100:00100000:1.0:1788636428.927883:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976393472 00000100:00100000:1.0:1788636428.927914:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788636428.927923:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976393472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636428.927981:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976393472:12345-0@lo:400:kworker.0 Request processed in 59us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636428.927988:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:1.0:1788636428.928018:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976393856 00000100:00100000:1.0:1788636428.928022:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976393856 00000100:00100000:1.0:1788636428.928049:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788636428.928056:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1875520976394112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636428.928105:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3283:x1875520976394112:12345-0@lo:400:kworker.0 Request processed in 49us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636428.928176:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788636428.928190:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788636428.928197:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976393856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636428.928227:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976393856:12345-0@lo:400:kworker.0 Request processed in 31us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636428.928233:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788636428.928275:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976394112:0@lo:400:kworker.0 00000100:00100000:1.0:1788636428.928308:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976393728 00000100:00100000:1.0:1788636428.928312:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976393728 00000100:00100000:1.0:1788636428.928337:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976393600 00000100:00100000:1.0:1788636428.928340:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976393600 00000100:00080000:3.0:1788636428.928821:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636428.928826:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636428.928828:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636428.929269:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788636428.929283:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976393728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636428.929339:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976393728:12345-0@lo:400:kworker.0 Request processed in 63us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636428.929345:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788636428.929427:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1788636428.929446:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976393600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636428.929480:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976393600:12345-0@lo:400:kworker.0 Request processed in 37us (2007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636428.929486:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788636428.929719:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976393600:0@lo:400:kworker.0 00000100:00100000:2.0:1788636428.929732:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976393728:0@lo:400:kworker.0 00000100:00100000:0.0:1788636428.930435:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636428.930484:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976393856:0@lo:400:kworker.0 00000100:00100000:0.0:1788636428.930503:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976393472:0@lo:400:kworker.0 00000100:00100000:3.0:1788636428.930529:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976393984 00000100:00100000:3.0:1788636428.930534:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976393984 00010000:00010000:1.0:1788636428.930577:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788636428.930832:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636428.930874:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788636428.930882:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976393984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636428.931097:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75bd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976393984:12345-0@lo:400:kworker.0 Request processed in 215us (661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636428.931104:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788636428.931213:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976393984:0@lo:400:kworker.0 00000100:00100000:0.0:1788636429.439214:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636429.439248:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976394240:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636429.439323:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636429.439376:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976394240 00000100:00100000:1.0:1788636429.439384:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976394240 00000100:00100000:1.0:1788636429.439430:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788636429.439439:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976394240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636429.439473:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636429.439527:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976394240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636429.439540:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788636429.439648:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75864a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976394240:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788636429.953099:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1788636430.500919:0:5832:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788636430.501294:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:2.0:1788636430.501323:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1788636430.501737:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1788636430.518688:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000100:00100000:3.0:1788636430.975144:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636430.975166:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976394368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636430.975232:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636430.975518:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976394368 00000100:00100000:0.0:1788636430.975527:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976394368 00000100:00100000:0.0:1788636430.975594:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788636430.975606:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976394368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636430.975643:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636430.975697:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976394368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636430.975704:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788636430.975748:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976394368:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788636430.975835:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788636430.975899:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788636431.403570:0:12346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 15:27:10 (1788636430) 00000100:00100000:1.0:1788636431.949225:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636431.949269:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636431.949355:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636431.949390:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636431.949420:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636431.949476:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963803392 00000100:00100000:0.0:1788636431.949484:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963803392 00000100:00100000:0.0:1788636431.949537:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963803008 00000100:00100000:0.0:1788636431.949541:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963803008 00000100:00100000:0.0:1788636431.949565:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 140 00000100:00100000:0.0:1788636431.949575:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2361:x1875520963803392:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636431.949642:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75864a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2361:x1875520963803392:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 69us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636431.949649:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 140 00000100:00100000:0.0:1788636431.949678:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 141 00000100:00100000:0.0:1788636431.949685:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+13:2361:x1875520963803008:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636431.949712:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75865f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+13:2361:x1875520963803008:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 28us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636431.949730:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 141 00000100:00080000:0.0:1788636431.949747:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636431.950323:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963802880 00000100:00100000:3.0:1788636431.950337:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963802880 00000100:00100000:2.0:1788636431.950440:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963803136 00000100:00100000:2.0:1788636431.950449:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963803136 00000100:00100000:3.0:1788636431.950483:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 289 00000100:00100000:3.0:1788636431.950501:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963802880:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636431.950507:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963803264 00000100:00100000:2.0:1788636431.950513:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963803264 00000100:00100000:2.0:1788636431.950543:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:2.0:1788636431.950553:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963803136:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636431.950575:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963802880:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 79us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636431.950585:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 289 00000100:00100000:2.0:1788636431.950601:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75866300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963803136:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 47us (1327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636431.950610:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:2.0:1788636431.950638:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 85 00000100:00100000:2.0:1788636431.950645:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963803264:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636431.950682:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963803264:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 38us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636431.950689:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 85 00000100:00080000:2.0:1788636431.950705:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636431.950717:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788636432.000378:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636432.738366:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636432.739212:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963803648 00000100:00100000:0.0:1788636432.739222:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963803648 00000100:00100000:0.0:1788636432.739346:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 137 00000100:00100000:0.0:1788636432.739357:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+13:11313:x1875520963803648:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636432.739377:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636432.739410:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7bbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155712 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.739514:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.739531:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.739543:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.739558:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.739565:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.739571:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740006:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7bd3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740030:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740038:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7bd3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636432.740048:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788636432.740188:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740195:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740202:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740208:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636432.740212:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740220:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740231:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:0.0:1788636432.740234:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636432.740238:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740244:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7bc5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740256:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740268:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740274:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740279:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636432.740282:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740289:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740297:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cfd500ebe00) 00010000:00010000:0.0:1788636432.740299:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636432.740301:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740312:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c400/0xa6aa59fb12fa7bcc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740696:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7bbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155712 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740712:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7bd3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155712 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636432.740720:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:0.0:1788636432.740722:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636432.740731:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c600, rc 0) 00000100:00100000:0.0:1788636432.740836:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+15:11313:x1875520963803648:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 1480us (2478us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1788636432.740844:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 137 00000100:00100000:2.0:1788636432.747587:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636432.747634:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636432.748771:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963803776 00000100:00100000:1.0:1788636432.748781:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963803776 00000100:00100000:1.0:1788636432.748954:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:1.0:1788636432.748965:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+15:2363:x1875520963803776:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636432.748980:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636432.749004:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7bd3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155712 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636432.749029:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:1.0:1788636432.749035:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636432.749097:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699a9850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:2363:x1875520963803776:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 133us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636432.749105:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:0.0:1788636432.749383:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963803904 00000100:00100000:0.0:1788636432.749389:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963803904 00000100:00100000:0.0:1788636432.749427:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 138 00000100:00100000:0.0:1788636432.749436:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:11313:x1875520963803904:12345-192.168.203.57@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788636432.749513:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:11313:x1875520963803904:12345-192.168.203.57@tcp:59:lhsmtool_posix.0 Request processed in 78us (1878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636432.749520:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 138 00010000:00010000:2.0:1788636433.026538:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636433.728780:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636433.728789:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636433.729342:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788636433.729351:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636434.047048:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976394752:0@lo:400:kworker.0 00000100:00100000:3.0:1788636434.047117:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636434.047296:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788636434.047303:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976394624:0@lo:400:kworker.0 00000100:00100000:3.0:1788636434.047334:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636434.047351:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976395136:0@lo:400:kworker.0 00000100:00100000:3.0:1788636434.047375:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636434.047413:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976394752 00000100:00100000:3.0:1788636434.047420:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976394752 00000100:00100000:3.0:1788636434.047475:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976394624 00000100:00100000:3.0:1788636434.047478:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976394624 00000100:00100000:3.0:1788636434.047501:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788636434.047509:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976394752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636434.047571:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976394752:12345-0@lo:400:kworker.0 Request processed in 63us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636434.047578:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788636434.047593:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788636434.047599:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976394624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636434.047626:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976394624:12345-0@lo:400:kworker.0 Request processed in 28us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636434.047632:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788636434.047649:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976395136 00000100:00100000:3.0:1788636434.047653:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976395136 00000100:00100000:3.0:1788636434.047682:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788636434.047689:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976395136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636434.047717:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976395136:12345-0@lo:400:kworker.0 Request processed in 29us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636434.047723:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1788636434.047738:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636434.047743:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636434.047775:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976394624:0@lo:400:kworker.0 00000100:00100000:3.0:1788636434.047819:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788636434.047825:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd7fe3d500, transno 4294967313 00000100:00100000:3.0:1788636434.047837:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41aa2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976395136:0@lo:400:kworker.0 00000100:00100000:3.0:1788636434.047848:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976394752:0@lo:400:kworker.0 00000100:00100000:2.0:1788636434.048112:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976394880:0@lo:400:kworker.0 00000100:00100000:2.0:1788636434.048144:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636434.048177:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788636434.048183:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976394496:0@lo:400:kworker.0 00000100:00100000:2.0:1788636434.048207:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636434.048227:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976395008:0@lo:400:kworker.0 00000100:00100000:2.0:1788636434.048246:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636434.048268:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976394880 00000100:00100000:2.0:1788636434.048272:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976394880 00000100:00100000:2.0:1788636434.048299:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788636434.048305:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976394880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636434.048337:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976394880:12345-0@lo:400:kworker.0 Request processed in 32us (192us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636434.048343:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788636434.048366:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976394880:0@lo:400:kworker.0 00000100:00100000:1.0:1788636434.048512:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976394496 00000100:00100000:1.0:1788636434.048516:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976394496 00000100:00100000:1.0:1788636434.048543:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788636434.048549:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976394496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636434.048593:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976394496:12345-0@lo:400:kworker.0 Request processed in 44us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636434.048600:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1788636434.048632:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976394496:0@lo:400:kworker.0 00000100:00100000:1.0:1788636434.049000:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976395008 00000100:00100000:1.0:1788636434.049006:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976395008 00000100:00100000:1.0:1788636434.049052:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788636434.049060:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976395008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636434.049097:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976395008:12345-0@lo:400:kworker.0 Request processed in 38us (849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636434.049102:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788636434.049127:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75a45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976395008:0@lo:400:kworker.0 00010000:00010000:2.0:1788636434.050386:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788636434.051113:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636434.051118:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636434.562228:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636434.562256:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976395264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636434.562359:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636434.562448:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976395264 00000100:00100000:1.0:1788636434.562459:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976395264 00000100:00100000:1.0:1788636434.562519:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788636434.562528:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976395264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636434.562569:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636434.562615:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976395264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636434.562622:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788636434.562673:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976395264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636434.935092:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636434.935128:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963804032 00000100:00100000:0.0:1788636434.935449:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963804032 00000100:00100000:0.0:1788636434.935521:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 139 00000100:00100000:0.0:1788636434.935532:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+14:11355:x1875520963804032:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636434.935552:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636434.935575:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7be1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155719 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.935649:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.935665:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.935676:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.935701:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.935708:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.935714:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788636434.936286:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636434.937104:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937137:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937150:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937155:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636434.937159:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937166:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937180:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636434.937183:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636434.937189:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937194:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7be8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937205:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937210:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937216:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937222:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191dc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636434.937231:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937237:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937244:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cfd500ebe00) 00010000:00010000:2.0:1788636434.937246:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636434.937249:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937255:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7bef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937295:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7be1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155719 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937305:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636434.937308:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636434.937311:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7be1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155719 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.937320:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d800, rc 0) 00000100:00100000:2.0:1788636434.937388:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+14:11355:x1875520963804032:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1858us (2301us total) trans 0 rc 301/301 00000100:00100000:2.0:1788636434.937396:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 139 00000100:00100000:3.0:1788636434.943365:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636434.943516:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963804288 00000100:00100000:0.0:1788636434.943525:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963804288 00000100:00100000:0.0:1788636434.943564:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 140 00000100:00100000:0.0:1788636434.943572:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+14:11355:x1875520963804288:12345-192.168.203.57@tcp:36:lfs.0 00010000:00010000:0.0:1788636434.943614:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636434.943635:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa755f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155552 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.943651:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636434.943655:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636434.945316:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.945363:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.945378:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.945413:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 5 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636434.945429:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 5 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636434.945444:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976395392:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636434.945532:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e13d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636434.950426:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976395392:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636434.950455:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636434.956362:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636434.956456:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963804416 00000100:00100000:0.0:1788636434.956467:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963804416 00010000:00010000:0.0:1788636434.956524:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 6 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788636434.956573:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636434.956713:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 60 00000100:00100000:0.0:1788636434.956724:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2362:x1875520963804416:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636434.956739:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636434.956756:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 6 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.956769:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 6 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.956791:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7bb7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515570b expref: 6 pid: 5810 timeout: 403 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.956851:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636434.956857:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.956867:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.956874:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.956910:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636434.956962:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2362:x1875520963804416:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 239us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636434.956969:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 60 00010000:00010000:3.0:1788636434.957111:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.957120:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.957152:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.957162:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.957170:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636434.958305:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788636434.958320:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.958328:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.958344:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.958350:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636434.958355:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.958363:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.958379:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636434.958382:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636434.958386:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636434.958392:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7bf6 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636434.958411:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d75620ad reply state 00000000dcd58c52 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636434.958419:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636434.958500:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+15:11355:x1875520963804288:12345-192.168.203.57@tcp:36:lfs.0 Request processed in 14925us (15140us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788636434.958507:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 140 00010000:00010000:0.0:1788636434.963696:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.963715:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.963722:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.963738:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636434.963743:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.963751:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.963768:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cfd42a85700) 00010000:00010000:0.0:1788636434.963771:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636434.963776:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636434.963782:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7bfd lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636435.058216:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.058285:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963804544 00000100:00100000:2.0:1788636435.058294:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963804544 00000100:00100000:2.0:1788636435.058389:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 141 00000100:00100000:2.0:1788636435.058401:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+14:11363:x1875520963804544:12345-192.168.203.57@tcp:101:lctl.0 00010000:00010000:2.0:1788636435.058426:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.058447:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7c04 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155720 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.058509:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7c0b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.058524:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.058551:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636435.058587:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788636435.058591:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636435.058612:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7c0b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.058637:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7c04 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155720 expref: 16 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.058656:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7c0b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155720 expref: 15 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.058665:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:2.0:1788636435.058668:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636435.058672:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb600, rc 0) 00000100:00100000:2.0:1788636435.058735:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+15:11363:x1875520963804544:12345-192.168.203.57@tcp:101:lctl.0 Request processed in 338us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636435.058742:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 141 00010000:00010000:1.0:1788636435.071155:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636435.139738:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.139911:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963804672 00000100:00100000:0.0:1788636435.139921:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963804672 00000100:00100000:0.0:1788636435.139981:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 142 00000100:00100000:0.0:1788636435.139991:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+15:11369:x1875520963804672:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636435.140017:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636435.140040:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7c12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155727 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140105:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140120:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140147:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140163:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140170:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140177:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140270:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7c27 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140278:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140284:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636435.140311:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788636435.140315:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636435.140334:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7c27 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140345:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140351:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140369:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140376:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191da00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.140380:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140388:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140400:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:0.0:1788636435.140403:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636435.140407:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140414:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7c19 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140429:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140435:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140441:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140446:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191ce00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.140450:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140467:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140475:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cfd500eb500) 00010000:00010000:0.0:1788636435.140478:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636435.140481:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140487:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7c20 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140529:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7c12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155727 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140543:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7c27 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155727 expref: 16 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.140550:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636435.140552:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788636435.140554:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d800, rc 0) 00000100:00100000:0.0:1788636435.140625:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+16:11369:x1875520963804672:12345-192.168.203.57@tcp:101:bash.0 Request processed in 634us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636435.140632:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 142 00000100:00100000:3.0:1788636435.145721:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.145822:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963804928 00000100:00100000:2.0:1788636435.145832:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963804928 00000100:00100000:2.0:1788636435.145903:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 143 00000100:00100000:2.0:1788636435.145915:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+16:11369:x1875520963804928:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:2.0:1788636435.145936:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.145958:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7c2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515572e expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146101:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146117:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146128:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146164:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146172:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146179:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636435.146715:0:7975:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788636435.146919:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146930:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146938:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146972:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146990:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.146997:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.147003:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636435.147007:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.147016:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.147028:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636435.147031:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636435.147036:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.147043:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c35 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636435.147057:0:7975:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dadff9a2 reply state 0000000099085809 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636435.147065:0:7975:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788636435.147097:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa7c2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 19 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.147112:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 18 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.147130:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636435.147133:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636435.147136:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb000, rc 0) 00000100:00100000:2.0:1788636435.147211:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+19:11369:x1875520963804928:12345-192.168.203.57@tcp:101:bash.0 Request processed in 1298us (1499us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788636435.147220:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 143 00000100:00100000:1.0:1788636435.157452:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.157938:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963805056 00000100:00100000:2.0:1788636435.157948:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963805056 00000100:00100000:2.0:1788636435.158053:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00100000:2.0:1788636435.158064:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963805056:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:2.0:1788636435.158079:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.158097:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155735 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636435.158122:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636435.158140:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:2.0:1788636435.158144:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636435.158154:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.158171:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.158183:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea200, rc 0) 00000100:00100000:2.0:1788636435.158233:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963805056:12345-192.168.203.57@tcp:101:bash.0 Request processed in 172us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636435.158251:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00080000:0.0:1788636435.159961:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788636435.167739:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.167772:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.167780:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.167785:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636435.167791:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.168198:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.168215:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd62575d00) 00010000:00010000:3.0:1788636435.168219:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636435.168223:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.168229:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c3c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636435.169194:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.171280:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963805184 00000100:00100000:2.0:1788636435.171293:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963805184 00000100:00100000:2.0:1788636435.171364:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:2.0:1788636435.171374:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+6:11369:x1875520963805184:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:2.0:1788636435.171391:0:6963:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.171409:0:6963:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515573c expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.171440:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.171449:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636435.171454:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636435.171459:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 7 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.171491:0:6963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.171505:0:6963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 7 pid: 6661 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636435.171519:0:6963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7a1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6963:1875520976395520:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636435.171928:0:6963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7faa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636435.190836:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.192877:0:6963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7a1b0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6963:1875520976395520:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636435.192923:0:6963:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 7 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.192964:0:6963:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb800, rc 0) 00000100:00100000:0.0:1788636435.193033:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+7:11369:x1875520963805184:12345-192.168.203.57@tcp:101:bash.0 Request processed in 21659us (23843us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636435.193041:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:1.0:1788636435.193141:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963805312 00000100:00100000:1.0:1788636435.193148:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963805312 00010000:00010000:1.0:1788636435.193189:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 7 pid: 6661 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636435.193230:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:1.0:1788636435.193239:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963805312:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636435.193252:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636435.193273:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 7 pid: 6661 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636435.193286:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 7 pid: 6661 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636435.193308:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa7c51 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155735 expref: 7 pid: 6661 timeout: 404 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636435.193322:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636435.193326:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636435.193335:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 6 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636435.193346:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 6 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636435.193381:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 6 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636435.193403:0:5795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1875520976395648:192.168.203.57@tcp:105: 00000100:00100000:1.0:1788636435.193474:0:5795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47efa9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636435.201789:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636435.201920:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963805568 00000100:00100000:3.0:1788636435.201931:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963805568 00000100:00100000:3.0:1788636435.201979:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:3.0:1788636435.201990:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+18:11369:x1875520963805568:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:3.0:1788636435.202339:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:11369:x1875520963805568:12345-192.168.203.57@tcp:35:bash.0 Request processed in 349us (561us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1788636435.202347:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:1.0:1788636435.202606:0:5795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1875520976395648:192.168.203.57@tcp:105: 00010000:00010000:1.0:1788636435.202628:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636435.202651:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963805312:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 9414us (11865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636435.202659:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:3.0:1788636435.312716:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.313142:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963805824 00000100:00100000:0.0:1788636435.313152:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963805824 00000100:00100000:0.0:1788636435.313247:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 144 00000100:00100000:0.0:1788636435.313258:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:11379:x1875520963805824:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636435.313281:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636435.313303:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7c5f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155743 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636435.313388:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788636435.313502:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7c5f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155743 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.313516:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:0.0:1788636435.313520:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636435.313525:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7c5f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155743 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.313539:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c200, rc 0) 00000100:00100000:0.0:1788636435.313603:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+20:11379:x1875520963805824:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 348us (896us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788636435.313611:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 144 00000100:00100000:2.0:1788636435.317661:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636435.317744:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963806080 00000100:00100000:3.0:1788636435.317754:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963806080 00000100:00100000:3.0:1788636435.317832:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:3.0:1788636435.317843:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+20:11379:x1875520963806080:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636435.318287:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+21:11379:x1875520963806080:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 445us (634us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788636435.318295:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:1.0:1788636435.412918:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.413102:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963806208 00000100:00100000:2.0:1788636435.413113:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963806208 00000100:00100000:2.0:1788636435.413172:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 145 00000100:00100000:2.0:1788636435.413182:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+21:11385:x1875520963806208:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636435.413204:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.413224:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7c6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515574a expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.413309:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7c74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.413322:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.413333:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636435.413365:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788636435.413369:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636435.413387:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7c74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.413411:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7c6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515574a expref: 23 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.413430:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7c74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515574a expref: 22 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.413451:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636435.413454:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636435.413458:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ebe00, rc 0) 00000100:00100000:2.0:1788636435.413518:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+22:11385:x1875520963806208:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 338us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636435.413525:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 145 00000100:00100000:3.0:1788636435.419613:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.419771:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963806464 00000100:00100000:2.0:1788636435.419781:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963806464 00000100:00100000:2.0:1788636435.419855:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 146 00000100:00100000:2.0:1788636435.419864:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+22:11385:x1875520963806464:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636435.419882:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.419910:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7c7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155751 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.419997:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.420022:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.420034:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636435.420046:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788636435.420173:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7c7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155751 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.420213:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155751 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.420222:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636435.420226:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636435.420230:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea000, rc 0) 00000100:00100000:2.0:1788636435.420292:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:11385:x1875520963806464:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 428us (685us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788636435.420299:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 146 00000100:00100000:3.0:1788636435.424040:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.424185:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963806720 00000100:00100000:2.0:1788636435.424194:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963806720 00000100:00100000:2.0:1788636435.424252:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 147 00000100:00100000:2.0:1788636435.424262:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+24:11385:x1875520963806720:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636435.424284:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.424307:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7c90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155758 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.424408:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c97 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.424423:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.424435:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c97 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636435.424448:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788636435.424590:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7c90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155758 expref: 27 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.424612:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155758 expref: 26 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.424622:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636435.424625:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788636435.424628:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ebc00, rc 0) 00000100:00100000:2.0:1788636435.424693:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+26:11385:x1875520963806720:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 432us (663us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788636435.424701:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 147 00000100:00100000:1.0:1788636435.432678:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.432780:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963806848 00000100:00100000:2.0:1788636435.432790:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963806848 00000100:00100000:2.0:1788636435.432883:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:2.0:1788636435.432903:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+26:2362:x1875520963806848:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636435.432919:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636435.432945:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7c82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155751 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.432965:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636435.432971:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636435.433028:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+25:2362:x1875520963806848:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 137us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636435.433035:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:3.0:1788636435.439450:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.439553:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963806976 00000100:00100000:0.0:1788636435.439563:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963806976 00000100:00100000:0.0:1788636435.439621:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:0.0:1788636435.439631:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963806976:12345-192.168.203.57@tcp:1:lfs.0 00010000:00010000:0.0:1788636435.439671:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.439691:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 6 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.439700:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636435.439704:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636435.439710:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.439757:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 6 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.439771:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 6 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636435.439786:0:6661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1875520976395776:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636435.439913:0:6661:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61066780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636435.443254:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.443352:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963807104 00000100:00100000:2.0:1788636435.443361:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963807104 00002000:00100000:2.0:1788636435.443427:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cfc41aa3100 x1875520963807104/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:676/0 lens 504/0 e 0 to 0 dl 1788636446 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788636435.443440:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfc41aa3100 with x1875520963807104 ext(0->12) 00010000:00010000:2.0:1788636435.443449:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 7 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.443466:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 7 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636435.443475:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cfc41aa3100 00000100:00100000:2.0:1788636435.443511:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:2.0:1788636435.443521:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963807104:12345-192.168.203.57@tcp:4:lfs.0 00000100:00100000:2.0:1788636435.444069:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963807104:12345-192.168.203.57@tcp:4:lfs.0 Request processed in 547us (822us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788636435.444078:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 2 00002000:00100000:2.0:1788636435.444086:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cfc41aa3100 x1875520963807104/t4294967305(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:676/0 lens 504/448 e 0 to 0 dl 1788636446 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788636435.444095:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfc41aa3100 with x1875520963807104 ext(0->12) 00010000:00010000:2.0:1788636435.444103:0:6666:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 9 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.444115:0:6666:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 9 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636435.444121:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cfc41aa3100 00000100:00100000:0.0:1788636435.445286:0:6661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1875520976395776:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636435.445312:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636435.447561:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.447922:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963807232 00000100:00100000:2.0:1788636435.447931:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963807232 00010000:00010000:2.0:1788636435.447966:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 9 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636435.448014:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 62 00000100:00100000:2.0:1788636435.448025:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+9:2360:x1875520963807232:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636435.448040:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788636435.448057:0:5796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788636435.448061:0:5796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788636435 00002000:00010000:2.0:1788636435.448063:0:5796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788636435 00002000:00010000:2.0:1788636435.448065:0:5796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788636435 00010000:00010000:2.0:1788636435.448071:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 9 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.448084:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 9 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.448106:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa7c58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb98284483515573c expref: 9 pid: 6963 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.448123:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636435.448127:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636435.448134:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.448145:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.448192:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636435.448241:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+8:2360:x1875520963807232:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 218us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636435.448248:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 62 00010000:00010000:0.0:1788636435.448400:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.448411:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.448433:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.448441:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.448450:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.448457:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636435.448461:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.448470:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.448481:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.448500:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fff41394/0xa6aa59fb12fa7ca5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636435.448541:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963806976:12345-192.168.203.57@tcp:1:lfs.0 Request processed in 8912us (9101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636435.448548:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:1.0:1788636435.451121:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.451315:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963807488 00000100:00100000:0.0:1788636435.451325:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963807488 00000100:00100000:0.0:1788636435.451381:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:0.0:1788636435.451391:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd507d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+25:11385:x1875520963807488:12345-192.168.203.57@tcp:35:lfs.0 00000004:00010000:0.0:1788636435.451457:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c97 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155758 expref: 25 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636435.451677:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788636435.451710:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788636435.453437:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788636435.453526:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.453545:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 29 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.453554:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.453591:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 29 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.453622:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 29 pid: 7975 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636435.453637:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1875520976395904:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636435.453737:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61066780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636435.457337:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.457406:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963807616 00000100:00100000:2.0:1788636435.457415:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963807616 00010000:00010000:2.0:1788636435.457453:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 30 pid: 7975 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636435.457499:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:2.0:1788636435.457510:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+30:2363:x1875520963807616:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636435.457524:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636435.457531:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 30 pid: 7975 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.457544:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 30 pid: 7975 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.457567:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636435.457574:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.457584:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.457591:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.457622:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636435.457676:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+30:2363:x1875520963807616:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 167us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636435.457683:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 63 00010000:00010000:0.0:1788636435.459266:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa7c43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515572e expref: 29 pid: 7975 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636435.459291:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1875520976395904:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636435.459314:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.459324:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.459329:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636435.459457:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1788636435.459627:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1788636435.459718:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976396032:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636435.460280:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636435.460313:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd610660c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636435.460372:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976396032 00000100:00100000:2.0:1788636435.460379:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976396032 00000100:00100000:2.0:1788636435.460425:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636435.460433:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976396032:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788636435.460507:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976396032:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 74us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636435.460514:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636435.460579:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976396032:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788636435.461093:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788636435.461161:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976396160:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636435.461203:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636435.461230:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61066780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636435.461412:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976396160 00000100:00100000:2.0:1788636435.461418:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976396160 00000100:00100000:2.0:1788636435.461442:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636435.461449:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976396160:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788636435.461586:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5814:x1875520976396160:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 136us (381us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788636435.461592:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636435.461658:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7eefb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976396160:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788636435.461697:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788636435.461728:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.461739:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.461747:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.461753:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.461757:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.461765:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.461779:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:0.0:1788636435.461782:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788636435.461786:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.461792:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cac lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636435.462010:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788636435.462129:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788636435.462140:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 304486343014ns, next at 305486341099ns, rc = 0 00000001:00080000:0.0:1788636435.462155:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788636435.462187:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:0.0:1788636435.462190:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788636435.462197:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa7c97 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155758 expref: 33 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636435.462299:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd507d4450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+32:11385:x1875520963807488:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 10909us (11186us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788636435.462306:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 38 00000020:00080000:0.0:1788636435.462310:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788636435.465294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.465564:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963807744 00000100:00100000:2.0:1788636435.465572:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963807744 00000100:00100000:2.0:1788636435.465640:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 148 00000100:00100000:2.0:1788636435.465647:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+32:11385:x1875520963807744:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636435.465666:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.465682:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7cb3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515575f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.465755:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515575f expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.465767:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7cb3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515575f expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.465780:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:2.0:1788636435.465782:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636435.465785:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea000, rc 0) 00000100:00100000:2.0:1788636435.465854:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+33:11385:x1875520963807744:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 208us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636435.465859:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 148 00000100:00100000:2.0:1788636435.468757:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636435.469322:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963808000 00000100:00100000:3.0:1788636435.469331:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963808000 00000100:00100000:3.0:1788636435.469421:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:3.0:1788636435.469430:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+33:11385:x1875520963808000:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636435.469613:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+34:11385:x1875520963808000:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 183us (870us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788636435.469625:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:3.0:1788636435.554542:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636435.554989:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963808256 00000100:00100000:2.0:1788636435.555000:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963808256 00000100:00100000:2.0:1788636435.555076:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 149 00000100:00100000:2.0:1788636435.555087:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+34:11395:x1875520963808256:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636435.555114:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636435.555136:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7cba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155766 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636435.555231:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788636435.555347:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7cba lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155766 expref: 36 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.555362:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:2.0:1788636435.555383:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636435.555390:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa7cba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155766 expref: 36 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636435.555406:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb400, rc 0) 00000100:00100000:2.0:1788636435.555469:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+35:11395:x1875520963808256:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 385us (937us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788636435.555477:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 149 00000100:00100000:2.0:1788636435.559622:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.559717:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963808384 00000100:00100000:0.0:1788636435.559735:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963808384 00000100:00100000:0.0:1788636435.559828:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 150 00000100:00100000:0.0:1788636435.559840:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+35:11395:x1875520963808384:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:0.0:1788636435.559928:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.559944:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.559955:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.559969:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.559977:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.559983:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560086:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560095:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560102:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636435.560143:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560154:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560160:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560167:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560173:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.560176:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560183:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560195:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636435.560197:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636435.560201:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560214:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7cc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560229:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560234:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560239:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560244:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191ce00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.560248:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560253:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560260:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd500eb500) 00010000:00010000:0.0:1788636435.560262:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636435.560265:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560270:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ccf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560284:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560289:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560300:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560304:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191da00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.560306:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560312:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560319:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:0.0:1788636435.560322:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636435.560324:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.560329:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636435.560403:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+35:11395:x1875520963808384:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 565us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636435.560412:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 150 00000100:00100000:3.0:1788636435.563137:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.563260:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963808640 00000100:00100000:0.0:1788636435.563268:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963808640 00000100:00100000:0.0:1788636435.563319:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:0.0:1788636435.563329:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+35:11395:x1875520963808640:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:0.0:1788636435.563542:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+36:11395:x1875520963808640:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 215us (412us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788636435.563550:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:3.0:1788636435.630710:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.631031:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963808896 00000100:00100000:0.0:1788636435.631041:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963808896 00000100:00100000:0.0:1788636435.631097:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 151 00000100:00100000:0.0:1788636435.631106:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+36:11398:x1875520963808896:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636435.631337:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636435.631359:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cdd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515576d expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631428:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631441:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631452:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631464:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631470:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631475:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631729:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631738:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631757:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636435.631767:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788636435.631954:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631962:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631969:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631975:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191ce00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.631979:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.631986:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.634532:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636435.634540:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636435.634548:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.634556:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7ce4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.634576:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.634582:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.634604:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.634610:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.634614:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.634620:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.634632:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd500eb500) 00010000:00010000:0.0:1788636435.634634:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636435.635252:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.635259:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7ceb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.635324:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa7cdd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 39 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.635339:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 38 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.635347:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:0.0:1788636435.635349:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636435.635356:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191dc00, rc 0) 00000100:00100000:0.0:1788636435.635431:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+38:11398:x1875520963808896:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 4324us (4729us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788636435.635449:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 151 00000100:00100000:3.0:1788636435.639429:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636435.639503:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963809024 00000100:00100000:0.0:1788636435.639512:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963809024 00000100:00100000:0.0:1788636435.639566:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 152 00000100:00100000:0.0:1788636435.639576:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+38:11398:x1875520963809024:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:0.0:1788636435.639638:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639655:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639666:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639691:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639697:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639706:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639712:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636435.639717:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639724:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639735:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:0.0:1788636435.639752:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636435.639758:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.639765:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa7d00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636435.639876:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+38:11398:x1875520963809024:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 301us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636435.639883:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 152 00000100:00100000:3.0:1788636435.646546:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636435.646637:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963809280 00000100:00100000:1.0:1788636435.646646:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963809280 00000100:00100000:1.0:1788636435.646696:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 41 00000100:00100000:1.0:1788636435.646705:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+38:11398:x1875520963809280:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:1.0:1788636435.647496:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+39:11398:x1875520963809280:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 788us (954us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788636435.647506:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 41 00000001:00080000:3.0:1788636435.666531:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967434 is committed 00000004:00080000:3.0:1788636435.666549:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788636435.666574:0:5832:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cfd61066540 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788636435.666579:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd6999fa00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd48eba3c0 00000020:00080000:3.0:1788636435.666582:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd6999f300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cfc41adfc00 00000020:00080000:2.0:1788636435.666666:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788636435.666888:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788636435.667472:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636435.667494:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd610e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976396288:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788636435.667563:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636435.668374:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976396288 00000100:00100000:0.0:1788636435.668383:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976396288 00000100:00100000:0.0:1788636435.670349:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636435.670369:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3281:x1875520976396288:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788636435.670399:0:6662:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1788636435.670435:0:6662:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9c6d13, atime: 0x6a9c6d13, ctime: 0x6a9c6d13, blocks: 0x1 00010000:00010000:0.0:1788636435.670443:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.670459:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=304s v=(0 0) 00010000:00010000:0.0:1788636435.670464:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636435.670470:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.670485:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.670494:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.670516:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636435.670534:0:6662:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636435.671269:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636435.671277:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.671286:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191ca00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636435.671290:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.671300:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.671316:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.671324:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000318ca776/0xa6aa59fb12fa7d07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636435.671343:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636435.671351:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636435.671353:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636435.672384:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3281:x1875520976396288:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2019us (4815us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788636435.672393:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:3.0:1788636435.672679:0:3281:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd610e8e00/2, rc 0, transno 4294967307 00000100:00100000:3.0:1788636435.672687:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd610e8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976396288:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788636436.005715:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636436.005863:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963809536 00000100:00100000:3.0:1788636436.005876:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963809536 00000100:00100000:3.0:1788636436.006038:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 153 00000100:00100000:3.0:1788636436.006052:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+19:11429:x1875520963809536:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:3.0:1788636436.006083:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636436.006110:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155774 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788636436.006207:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788636436.006236:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.006255:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.006270:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636436.006282:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788636436.006491:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155774 expref: 22 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.006514:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155774 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.006523:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.006544:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636436.006548:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d000, rc 0) 00000100:00100000:3.0:1788636436.006620:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+21:11429:x1875520963809536:12345-192.168.203.57@tcp:101:cat.0 Request processed in 572us (919us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788636436.006628:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 153 00000100:00100000:3.0:1788636436.010905:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636436.013346:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963809664 00000100:00100000:2.0:1788636436.013369:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963809664 00000100:00100000:2.0:1788636436.013489:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:2.0:1788636436.013504:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+21:2363:x1875520963809664:12345-192.168.203.57@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788636436.013524:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00010000:00010000:2.0:1788636436.013528:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788636436.013560:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963809920 00000100:00100000:3.0:1788636436.013568:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963809920 00010000:00010000:2.0:1788636436.013570:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155774 expref: 21 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.013599:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00000100:00100000:3.0:1788636436.013600:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 42 00010000:00010000:2.0:1788636436.013609:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636436.013611:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+21:11429:x1875520963809920:12345-192.168.203.57@tcp:35:cat.0 00000100:00100000:2.0:1788636436.013686:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+21:2363:x1875520963809664:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 185us (2806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636436.013694:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:3.0:1788636436.015393:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+21:11429:x1875520963809920:12345-192.168.203.57@tcp:35:cat.0 Request processed in 1771us (1858us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788636436.015407:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:0.0:1788636436.053153:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636436.053456:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963810176 00000100:00100000:3.0:1788636436.053469:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963810176 00000100:00100000:3.0:1788636436.053600:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 154 00000100:00100000:3.0:1788636436.053612:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+21:11435:x1875520963810176:12345-192.168.203.57@tcp:101:dd.0 00010000:00010000:3.0:1788636436.053644:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636436.053647:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788636436.053679:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7c74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515574a expref: 21 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.053703:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:3.0:1788636436.053709:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636436.053725:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d23 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515577b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.053934:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.053950:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 21 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.053958:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.053994:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 21 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.054007:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 21 pid: 7975 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636436.054021:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976396416:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636436.054142:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e7f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636436.056908:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976396416:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636436.056927:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00010000:00010000:3.0:1788636436.056948:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636436.057093:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963810304 00000100:00100000:0.0:1788636436.057102:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963810304 00010000:00010000:0.0:1788636436.057146:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 22 pid: 7975 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636436.057191:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00100000:0.0:1788636436.057210:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+22:2362:x1875520963810304:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636436.057225:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636436.057238:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 22 pid: 7975 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.057252:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 22 pid: 7975 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.057281:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7cf2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515576d expref: 22 pid: 7975 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.057321:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:0.0:1788636436.057327:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.057337:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.057347:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.057377:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636436.057423:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.057433:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636436.057442:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699a8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+21:2362:x1875520963810304:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 241us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636436.057449:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 64 00000004:00200000:3.0:1788636436.057460:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788636436.057677:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d23 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 22 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.057699:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.057708:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.057712:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788636436.057715:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636436.057772:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+21:11435:x1875520963810176:12345-192.168.203.57@tcp:101:dd.0 Request processed in 4161us (4757us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788636436.057780:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 154 00000100:00100000:2.0:1788636436.064201:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636436.064323:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963810560 00000100:00100000:0.0:1788636436.064336:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963810560 00000100:00100000:0.0:1788636436.064413:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 155 00000100:00100000:0.0:1788636436.064426:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+21:11435:x1875520963810560:12345-192.168.203.57@tcp:36:dd.0 00010000:00010000:0.0:1788636436.065008:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.065032:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.065046:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636436.065115:0:7975:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788636436.065145:0:7975:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000063f82135 reply state 00000000c660571c transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636436.065173:0:7975:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788636436.065341:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+24:11435:x1875520963810560:12345-192.168.203.57@tcp:36:dd.0 Request processed in 915us (1153us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788636436.065350:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 155 00000020:00080000:0.0:1788636436.065356:0:7975:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788636436.068394:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.068416:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.068426:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.068433:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191dc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636436.068439:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.068449:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.068471:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.068475:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636436.068500:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.068508:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7d38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636436.096158:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636436.096289:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976396544:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788636436.096350:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636436.096405:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636436.096551:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976396544 00000100:00100000:1.0:1788636436.096560:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976396544 00000100:00080000:0.0:1788636436.096611:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636436.096634:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788636436.096647:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875520976396544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636436.096693:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636436.096763:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3280:x1875520976396544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636436.096770:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788636436.096899:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976396544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636436.473428:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636436.476181:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963810688 00000100:00100000:0.0:1788636436.476196:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963810688 00000100:00100000:0.0:1788636436.476275:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 156 00000100:00100000:0.0:1788636436.476286:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+23:11449:x1875520963810688:12345-192.168.203.57@tcp:101:stat.0 00010000:00010000:0.0:1788636436.476310:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636436.476331:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7d3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155782 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.476528:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.476546:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.476559:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.476576:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.476583:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.476606:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.477523:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.477540:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.477549:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.477589:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.477605:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 24 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636436.477623:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976396672:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636436.477733:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6131ce40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636436.480490:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636436.480622:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963810944 00000100:00100000:1.0:1788636436.480632:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963810944 00000100:00100000:1.0:1788636436.480687:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 43 00000100:00100000:1.0:1788636436.480699:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+25:5597:x1875520963810944:12345-192.168.203.57@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788636436.481068:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+26:5597:x1875520963810944:12345-192.168.203.57@tcp:35:ldlm_bl.0 Request processed in 369us (586us total) trans 4294967442 rc 0/0 00000100:00100000:1.0:1788636436.481076:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 43 00000100:00100000:2.0:1788636436.482557:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976396672:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636436.482585:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636436.483752:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636436.484399:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963811072 00000100:00100000:3.0:1788636436.484408:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963811072 00010000:00010000:3.0:1788636436.484447:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 26 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636436.484878:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 65 00000100:00100000:3.0:1788636436.484901:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+26:2362:x1875520963811072:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636436.484927:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636436.484935:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 26 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.484948:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 26 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.484970:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d2a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515577b expref: 26 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.484986:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.484991:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.485010:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.485032:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.485066:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636436.485126:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818df800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+25:2362:x1875520963811072:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 240us (1379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636436.485134:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 65 00010000:00010000:0.0:1788636436.485202:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485212:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636436.485258:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788636436.485262:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636436.485296:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485309:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485318:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485324:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485330:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485336:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636436.485340:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485348:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485358:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636436.485361:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636436.485364:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485371:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7d46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485382:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485388:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485401:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485406:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191de00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636436.485409:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485416:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485425:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636436.485427:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636436.485430:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485435:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7d4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485471:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7d3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155782 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485485:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155782 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.485492:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:0.0:1788636436.485494:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636436.485497:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c800, rc 0) 00000100:00100000:0.0:1788636436.485524:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:11449:x1875520963810688:12345-192.168.203.57@tcp:101:stat.0 Request processed in 9242us (12106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636436.485541:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 156 00000100:00100000:0.0:1788636436.566907:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636436.566985:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963811328 00000100:00100000:3.0:1788636436.566995:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963811328 00000100:00100000:3.0:1788636436.567113:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 157 00000100:00100000:3.0:1788636436.567122:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+24:11455:x1875520963811328:12345-192.168.203.57@tcp:36:truncate.0 00010000:00010000:3.0:1788636436.567171:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636436.567194:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7d54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155782 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.567212:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.567217:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636436.567411:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.567424:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.567434:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636436.567477:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788636436.567496:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000af151a7f reply state 0000000000b737af transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636436.567523:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636436.567617:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+26:11455:x1875520963811328:12345-192.168.203.57@tcp:36:truncate.0 Request processed in 495us (729us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788636436.567623:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 157 00000020:00080000:3.0:1788636436.567628:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788636436.571636:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.571654:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.571661:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.571667:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636436.571672:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.571679:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.571695:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.571698:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636436.571702:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.571708:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d5b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636436.722301:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636436.722412:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963811456 00000100:00100000:3.0:1788636436.722445:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963811456 00000100:00100000:3.0:1788636436.722521:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 158 00000100:00100000:3.0:1788636436.722533:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+25:11470:x1875520963811456:12345-192.168.203.57@tcp:101:stat.0 00010000:00010000:3.0:1788636436.722565:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636436.722596:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d62 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155789 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.723584:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.723610:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.723626:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.723659:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.723668:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.723675:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724111:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724122:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724131:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636436.724187:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788636436.724192:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636436.724221:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724236:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724245:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724251:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724258:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724264:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636436.724269:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724278:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724292:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:3.0:1788636436.724295:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636436.724300:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724308:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7d69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724333:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724339:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724345:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724351:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636436.724354:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724360:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724367:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd42a85100) 00010000:00010000:3.0:1788636436.724370:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636436.724372:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724378:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7d70 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724420:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d62 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 27 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724435:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 26 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.724455:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.724457:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636436.724460:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997ca00, rc 0) 00000100:00100000:3.0:1788636436.724562:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+26:11470:x1875520963811456:12345-192.168.203.57@tcp:101:stat.0 Request processed in 2030us (2274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636436.724571:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 158 00000040:00080000:2.0:1788636436.799144:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636436.799155:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636436.799543:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788636436.799550:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636436.821421:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636436.821500:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963811712 00000100:00100000:3.0:1788636436.821513:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963811712 00000100:00100000:3.0:1788636436.821585:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 159 00000100:00100000:3.0:1788636436.821596:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+26:11480:x1875520963811712:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636436.821621:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636436.822494:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155790 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636436.822643:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788636436.822939:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d7e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155790 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.822959:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:3.0:1788636436.822963:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636436.822970:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7d7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155790 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.823116:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636436.823213:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+27:11480:x1875520963811712:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1617us (1802us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1788636436.823247:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 159 00000100:00100000:1.0:1788636436.827308:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636436.827789:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963811968 00000100:00100000:0.0:1788636436.828047:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963811968 00000100:00100000:0.0:1788636436.828182:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:0.0:1788636436.828197:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd507d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+27:11480:x1875520963811968:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:0.0:1788636436.828529:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd507d5850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+28:11480:x1875520963811968:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 335us (1235us total) trans 4294967446 rc 0/0 00000100:00100000:0.0:1788636436.828536:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:0.0:1788636436.890037:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636436.890303:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963812224 00000100:00100000:2.0:1788636436.890316:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963812224 00000100:00100000:2.0:1788636436.890392:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 160 00000100:00100000:2.0:1788636436.890403:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+28:11486:x1875520963812224:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:2.0:1788636436.890433:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636436.890459:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7d8c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155797 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.890599:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.890618:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.890628:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.890671:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 29 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.890707:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 29 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636436.890723:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976396800:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636436.891242:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fa180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636436.899157:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636436.900204:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963812352 00000100:00100000:0.0:1788636436.900220:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963812352 00010000:00010000:0.0:1788636436.900285:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 30 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636436.900344:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 66 00000100:00100000:0.0:1788636436.900355:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+30:2363:x1875520963812352:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636436.900376:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636436.900384:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 30 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.900400:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 30 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.900430:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:0.0:1788636436.900452:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.900464:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.900472:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.900498:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636436.900576:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+30:2363:x1875520963812352:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 223us (1432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636436.900585:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 66 00010000:00010000:2.0:1788636436.902489:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7d77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155789 expref: 29 pid: 5810 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636436.902524:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5e8700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976396800:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636436.902556:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.902569:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.902575:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636436.902602:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788636436.903462:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7d8c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 30 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.903494:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.903506:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:2.0:1788636436.903528:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636436.903533:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea800, rc 0) 00000100:00100000:2.0:1788636436.903623:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+29:11486:x1875520963812224:12345-192.168.203.57@tcp:101:bash.0 Request processed in 13220us (13599us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788636436.903633:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 160 00000100:00100000:1.0:1788636436.906423:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636436.906599:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963812608 00000100:00100000:0.0:1788636436.906612:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963812608 00000100:00100000:0.0:1788636436.906690:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 161 00000100:00100000:0.0:1788636436.906703:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+29:11486:x1875520963812608:12345-192.168.203.57@tcp:36:bash.0 00010000:00010000:0.0:1788636436.907323:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.907346:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636436.907361:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636436.907428:0:7975:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1788636436.907456:0:7975:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec460235 reply state 00000000da6c64ea transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636436.907467:0:7975:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788636436.907606:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+32:11486:x1875520963812608:12345-192.168.203.57@tcp:36:bash.0 Request processed in 904us (1193us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1788636436.907615:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 161 00000020:00080000:0.0:1788636436.907621:0:7975:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788636436.912031:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.912062:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.912071:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.912079:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191de00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636436.912084:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.912093:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.912114:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.912118:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636436.912124:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.912130:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7da1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636436.918081:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636436.918482:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963812736 00000100:00100000:3.0:1788636436.918496:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963812736 00000100:00100000:3.0:1788636436.918615:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 162 00000100:00100000:3.0:1788636436.918628:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+31:11486:x1875520963812736:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:3.0:1788636436.918659:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636436.918700:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7da8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515579e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.918965:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.918982:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.919003:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.919047:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 32 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.919062:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 32 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636436.919078:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976396928:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636436.919181:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e7f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636436.921427:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590e680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976396928:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636436.921528:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636436.921598:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636436.921901:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963812864 00000100:00100000:2.0:1788636436.921911:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963812864 00010000:00010000:2.0:1788636436.921958:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 33 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636436.922006:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 67 00000100:00100000:2.0:1788636436.922019:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+33:2362:x1875520963812864:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636436.922037:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636436.922052:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 33 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.922067:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 33 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.922094:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7d93 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155797 expref: 33 pid: 5811 timeout: 405 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.922117:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:2.0:1788636436.922123:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.922135:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.922165:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636436.922193:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636436.922234:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.922244:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636436.922259:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+32:2362:x1875520963812864:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 240us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636436.922271:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 67 00000004:00200000:3.0:1788636436.922319:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788636436.922325:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636436.922349:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.922386:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7da8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515579e expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.922404:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515579e expref: 31 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636436.922413:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636436.922416:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636436.922419:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d000, rc 0) 00000100:00100000:3.0:1788636436.922448:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+31:11486:x1875520963812736:12345-192.168.203.57@tcp:101:bash.0 Request processed in 3824us (4383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636436.922456:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 162 00000100:00100000:1.0:1788636436.925264:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636436.925420:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963813120 00000100:00100000:3.0:1788636436.925433:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963813120 00000100:00100000:3.0:1788636436.925558:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:3.0:1788636436.925571:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+31:11486:x1875520963813120:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:3.0:1788636436.925923:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+32:11486:x1875520963813120:12345-192.168.203.57@tcp:35:bash.0 Request processed in 354us (672us total) trans 4294967450 rc 0/0 00000100:00100000:3.0:1788636436.925932:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:0.0:1788636437.006307:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636437.006447:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963813376 00000100:00100000:3.0:1788636437.006463:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963813376 00000100:00100000:3.0:1788636437.006568:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 163 00000100:00100000:3.0:1788636437.006581:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+32:11496:x1875520963813376:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636437.006615:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636437.006643:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7db6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557a5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636437.006779:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788636437.007257:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7db6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557a5 expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.007276:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:2.0:1788636437.007279:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636437.007286:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7db6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557a5 expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.007302:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:2.0:1788636437.007384:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+33:11496:x1875520963813376:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 807us (1092us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788636437.007392:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 163 00000100:00100000:1.0:1788636437.020096:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.021202:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963813504 00000100:00100000:2.0:1788636437.021221:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963813504 00000100:00100000:2.0:1788636437.021309:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 164 00000100:00100000:2.0:1788636437.021322:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+33:11496:x1875520963813504:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:2.0:1788636437.021431:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.021453:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.021489:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.021508:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.021516:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.021523:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022135:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022148:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022157:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636437.022215:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022230:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022238:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022246:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022264:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636437.022269:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022279:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022295:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636437.022298:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636437.022305:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022313:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7dc4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022332:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022338:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022345:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022350:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636437.022353:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022360:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022380:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd62575e00) 00010000:00010000:2.0:1788636437.022383:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636437.022386:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022393:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7dcb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022411:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022418:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022424:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022430:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636437.022433:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022440:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022448:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:2.0:1788636437.022451:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636437.022454:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.022460:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dd2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636437.024049:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+33:11496:x1875520963813504:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 2713us (3952us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636437.024065:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 164 00000100:00100000:3.0:1788636437.029493:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.029576:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963813760 00000100:00100000:0.0:1788636437.029589:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963813760 00000100:00100000:0.0:1788636437.029672:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:0.0:1788636437.029684:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+33:11496:x1875520963813760:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:0.0:1788636437.030702:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+34:11496:x1875520963813760:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 1014us (1216us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1788636437.030713:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:0.0:1788636437.072851:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.072906:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.072953:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.072976:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.073006:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.073042:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963814016 00000100:00100000:0.0:1788636437.073054:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963814016 00000100:00100000:0.0:1788636437.073127:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963814144 00000100:00100000:0.0:1788636437.073131:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963814144 00000100:00100000:0.0:1788636437.073161:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 88 00000100:00100000:0.0:1788636437.073174:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963814016:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636437.073265:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963814016:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 94us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636437.073274:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 88 00000100:00100000:0.0:1788636437.073293:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 89 00000100:00100000:0.0:1788636437.073318:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963814144:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636437.073348:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963814144:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 32us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636437.073353:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 89 00000100:00080000:0.0:1788636437.073372:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636437.073377:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636437.073492:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963814272 00000100:00100000:0.0:1788636437.073498:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963814272 00000100:00100000:0.0:1788636437.073533:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963814528 00000100:00100000:0.0:1788636437.073537:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963814528 00000100:00100000:0.0:1788636437.073559:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 145 00000100:00100000:0.0:1788636437.073567:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2363:x1875520963814272:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636437.073602:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2363:x1875520963814272:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 36us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636437.073609:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 145 00000100:00100000:0.0:1788636437.073623:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 165 00000100:00100000:0.0:1788636437.073630:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+34:11499:x1875520963814528:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636437.073648:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636437.073673:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa7dd9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557ac expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.073779:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.073828:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.073843:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.073867:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.073876:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.073893:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074271:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7dee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074282:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074290:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7dee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636437.074301:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788636437.074415:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074424:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074432:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074438:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191de00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636437.074443:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074464:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074479:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636437.074483:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636437.074489:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074496:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191de00/0xa6aa59fb12fa7de0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074511:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074517:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074524:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074529:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636437.074532:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074539:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074546:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636437.074549:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636437.074552:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074568:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7de7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074623:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191cc00/0xa6aa59fb12fa7dd9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557ac expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074639:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7dee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557ac expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.074647:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:0.0:1788636437.074649:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636437.074652:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d000, rc 0) 00000100:00100000:0.0:1788636437.074692:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc4222c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+36:11499:x1875520963814528:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1062us (1684us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1788636437.074699:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 165 00000100:00080000:0.0:1788636437.074734:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636437.074924:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963813888 00000100:00100000:3.0:1788636437.074932:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963813888 00000100:00100000:3.0:1788636437.074984:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 291 00000100:00100000:3.0:1788636437.074993:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963813888:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636437.075026:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963813888:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 36us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636437.075033:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 291 00000100:00100000:0.0:1788636437.080216:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.080388:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636437.080589:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963814784 00000100:00100000:1.0:1788636437.080602:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963814784 00000100:00100000:1.0:1788636437.080686:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:1.0:1788636437.080699:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+36:2362:x1875520963814784:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636437.080720:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636437.080774:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d000/0xa6aa59fb12fa7dee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557ac expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.080845:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:1.0:1788636437.080852:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636437.080932:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+35:2362:x1875520963814784:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 235us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636437.080940:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:2.0:1788636437.085049:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963814656 00000100:00100000:2.0:1788636437.085071:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963814656 00000100:00100000:2.0:1788636437.085168:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 166 00000100:00100000:2.0:1788636437.085182:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+35:11499:x1875520963814656:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:2.0:1788636437.085277:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085298:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085313:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085346:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085354:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085362:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085369:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636437.085374:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085382:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085414:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:2.0:1788636437.085418:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636437.085423:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.085431:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7dfc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636437.085540:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+35:11499:x1875520963814656:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 361us (5336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636437.085549:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 166 00000100:00100000:0.0:1788636437.097288:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.104151:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963815040 00000100:00100000:2.0:1788636437.104172:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963815040 00000100:00100000:2.0:1788636437.104254:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 47 00000100:00100000:2.0:1788636437.104267:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+35:11499:x1875520963815040:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636437.104619:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+36:11499:x1875520963815040:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 353us (7346us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788636437.104628:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 47 00010000:00010000:1.0:1788636437.121089:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636437.246760:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636437.246940:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963815296 00000100:00100000:3.0:1788636437.246955:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963815296 00000100:00100000:3.0:1788636437.247040:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 167 00000100:00100000:3.0:1788636437.247053:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+36:11517:x1875520963815296:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:3.0:1788636437.247084:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636437.247114:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7e03 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557b3 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.247252:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e0a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.247269:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.247304:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e0a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636437.247320:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788636437.247491:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7e03 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557b3 expref: 39 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.247513:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e0a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557b3 expref: 38 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.247523:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:3.0:1788636437.247527:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788636437.247531:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d600, rc 0) 00000100:00100000:3.0:1788636437.247600:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+38:11517:x1875520963815296:12345-192.168.203.57@tcp:101:cat.0 Request processed in 549us (853us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1788636437.247609:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 167 00000100:00100000:3.0:1788636437.282125:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.282250:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963815424 00000100:00100000:2.0:1788636437.282269:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963815424 00000100:00100000:2.0:1788636437.282366:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 168 00000100:00100000:2.0:1788636437.282380:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+38:11518:x1875520963815424:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636437.282415:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636437.282445:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557ba expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.282552:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7e1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.282591:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.282606:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636437.282656:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788636437.282661:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636437.282685:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7e1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.282719:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557ba expref: 40 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.283034:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7e1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557ba expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.283046:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636437.283050:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636437.283054:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea600, rc 0) 00000100:00100000:2.0:1788636437.283150:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+39:11518:x1875520963815424:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 772us (1033us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636437.283159:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 168 00000100:00100000:0.0:1788636437.294337:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.294516:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963815808 00000100:00100000:2.0:1788636437.294530:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963815808 00000100:00100000:2.0:1788636437.294636:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00100000:2.0:1788636437.294658:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+39:11518:x1875520963815808:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636437.297199:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+40:11518:x1875520963815808:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 2525us (2862us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788636437.297240:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00100000:3.0:1788636437.302371:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.302462:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963815936 00000100:00100000:0.0:1788636437.302475:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963815936 00000100:00100000:0.0:1788636437.302561:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:0.0:1788636437.302573:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+40:11518:x1875520963815936:12345-192.168.203.57@tcp:103:lfs.0 00010000:00010000:0.0:1788636437.302594:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788636437.302629:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7daf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515579e expref: 40 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.302675:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557b3 expref: 39 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.302689:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7cb3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515575f expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.302704:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd62575f00) 00010000:00010000:0.0:1788636437.302718:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636437.303175:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+37:11518:x1875520963815936:12345-192.168.203.57@tcp:103:lfs.0 Request processed in 602us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636437.303184:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:3.0:1788636437.306325:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.306608:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963816064 00000100:00100000:0.0:1788636437.306623:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963816064 00000100:00100000:0.0:1788636437.306702:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 169 00000100:00100000:0.0:1788636437.306715:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+37:11518:x1875520963816064:12345-192.168.203.57@tcp:58:lfs.0 00010000:00010000:0.0:1788636437.306966:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.307000:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.307015:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788636437.307422:0:7975:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788636437.307533:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+37:11518:x1875520963816064:12345-192.168.203.57@tcp:58:lfs.0 Request processed in 819us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636437.307552:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 169 00000100:00100000:1.0:1788636437.347572:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636437.347682:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963816192 00000100:00100000:3.0:1788636437.347696:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963816192 00000100:00100000:3.0:1788636437.347789:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 170 00000100:00100000:3.0:1788636437.347832:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+37:11520:x1875520963816192:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636437.347860:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636437.347898:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7e2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557c1 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348244:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348265:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348280:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348303:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348311:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348319:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348691:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348702:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.348711:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636437.350582:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788636437.350593:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636437.350634:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350688:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350704:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350714:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350724:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350748:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636437.350755:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350767:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350790:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:3.0:1788636437.350822:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636437.350830:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350839:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7e34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350861:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350867:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350889:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350895:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636437.350898:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350904:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350913:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd42a85100) 00010000:00010000:3.0:1788636437.350916:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636437.350919:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350924:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e3b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.350983:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7e2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 39 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.352173:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 38 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.352184:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:3.0:1788636437.352187:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636437.352190:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:3.0:1788636437.352377:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+38:11520:x1875520963816192:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 4548us (4820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636437.352405:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 170 00000040:00080000:2.0:1788636437.824491:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636437.824501:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636437.824559:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788636437.824566:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788636437.824957:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5e8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976397056:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788636437.825168:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636437.835424:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636437.835469:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963816320 00000100:00100000:1.0:1788636437.835481:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963816320 00000100:00100000:1.0:1788636437.835549:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 171 00000100:00100000:1.0:1788636437.835562:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+39:11531:x1875520963816320:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788636437.835605:0:7975:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788636437.835755:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+39:11531:x1875520963816320:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 194us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636437.835763:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 171 00000100:00100000:2.0:1788636437.839169:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5e8700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976397056:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788636437.840347:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.840420:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963816448 00000100:00100000:2.0:1788636437.840432:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963816448 00000100:00100000:2.0:1788636437.840505:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 172 00000100:00100000:2.0:1788636437.840518:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+38:11531:x1875520963816448:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788636437.840614:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.840637:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.840652:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.840671:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.840678:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.840686:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.840736:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.840746:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.840753:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636437.841031:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788636437.841036:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636437.841054:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841137:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841146:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841154:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841161:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636437.841166:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841176:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841192:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:2.0:1788636437.841203:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636437.841210:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841217:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea400/0xa6aa59fb12fa7e49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841234:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841241:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841248:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841253:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636437.841256:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841263:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841272:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9cfd62575600) 00010000:00010000:2.0:1788636437.841274:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636437.841277:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841283:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e50 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841300:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841313:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841319:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841325:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebe00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636437.841328:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841335:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841344:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:2.0:1788636437.841347:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636437.841350:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.841357:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636437.841935:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+38:11531:x1875520963816448:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 Request processed in 1414us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636437.841947:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 172 00000100:00100000:1.0:1788636437.859272:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.859388:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963816704 00000100:00100000:2.0:1788636437.859402:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963816704 00000100:00100000:2.0:1788636437.859507:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 173 00000100:00100000:2.0:1788636437.859519:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+38:11531:x1875520963816704:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636437.859546:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636437.859582:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557c8 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.859710:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.859728:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.859743:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636437.859757:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788636437.860093:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860103:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860111:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860118:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636437.860123:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860132:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860147:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:2.0:1788636437.860150:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636437.860157:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860177:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860234:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e5e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557c8 expref: 40 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860246:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:2.0:1788636437.860249:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636437.860253:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557c8 expref: 40 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.860263:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ebe00, rc 0) 00000100:00100000:2.0:1788636437.860390:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43852300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+39:11531:x1875520963816704:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 872us (1131us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788636437.860398:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 173 00000100:00100000:1.0:1788636437.864677:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.865064:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963816832 00000100:00100000:2.0:1788636437.865076:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963816832 00000100:00100000:2.0:1788636437.865143:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 174 00000100:00100000:2.0:1788636437.865154:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+39:11531:x1875520963816832:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788636437.865593:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788636437.865787:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43851f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+39:11531:x1875520963816832:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 625us (1114us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636437.865821:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 174 00000100:00100000:1.0:1788636437.877098:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.878293:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963817088 00000100:00100000:2.0:1788636437.878308:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963817088 00000100:00100000:2.0:1788636437.878387:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 175 00000100:00100000:2.0:1788636437.878408:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+39:11531:x1875520963817088:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636437.878434:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636437.878438:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788636437.878472:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa7e1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557ba expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.878496:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636437.878503:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636437.878519:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557cf expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788636437.881472:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1788636437.884311:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e7a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.884344:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.884360:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e7a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.884505:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa7e73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557cf expref: 41 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.884531:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e7a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557cf expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636437.884541:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd62575600) 00010000:00010000:2.0:1788636437.884544:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636437.884565:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea000, rc 0) 00000100:00100000:2.0:1788636437.884676:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43850e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+40:11531:x1875520963817088:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 6271us (7589us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788636437.884688:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 175 00000100:00100000:3.0:1788636437.892102:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.894149:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963817344 00000100:00100000:0.0:1788636437.894169:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963817344 00000100:00100000:0.0:1788636437.894252:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 176 00000100:00100000:0.0:1788636437.894265:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+40:11531:x1875520963817344:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788636437.894343:0:5810:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636437.894381:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa7e7a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557cf expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894402:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd62575600) 00010000:00010000:0.0:1788636437.894417:0:5810:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636437.894450:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894467:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894479:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894496:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894503:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894511:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894748:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894761:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894768:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894774:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636437.894779:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894787:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894837:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636437.894841:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636437.894845:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894851:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7e88 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894862:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894868:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894874:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894889:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636437.894898:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894905:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894913:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x43664cfc (ffff9cfd500eb800) 00010000:00010000:0.0:1788636437.894916:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636437.894919:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.894925:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7e8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x43664cfc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636437.895036:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+39:11531:x1875520963817344:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 772us (2949us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636437.895044:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 176 00000100:00100000:0.0:1788636437.901040:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636437.901609:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963817472 00000100:00100000:3.0:1788636437.901626:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963817472 00000100:00100000:3.0:1788636437.901704:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 177 00000100:00100000:3.0:1788636437.901717:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+39:11531:x1875520963817472:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636437.902101:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636437.902311:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7e96 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557d6 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.902362:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.902834:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.902851:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.903081:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7e96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 41 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.903105:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 40 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.903115:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:3.0:1788636437.903118:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636437.903430:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d000, rc 0) 00000100:00100000:3.0:1788636437.903538:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+40:11531:x1875520963817472:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 1822us (2509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636437.903550:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 177 00000100:00100000:2.0:1788636437.906778:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636437.907553:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963817728 00000100:00100000:3.0:1788636437.907568:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963817728 00000100:00100000:3.0:1788636437.907645:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 178 00000100:00100000:3.0:1788636437.907658:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+40:11531:x1875520963817728:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636437.907786:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.907826:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.907842:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636437.909167:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1788636437.909182:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 306933385259ns, next at 307933382448ns, rc = 0 00000004:00010000:3.0:1788636437.909308:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009208fd48 reply state 000000004548d013 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636437.909321:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636437.909524:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+42:11531:x1875520963817728:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 1864us (2758us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1788636437.909534:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 178 00010000:00010000:3.0:1788636437.911946:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636437.911967:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00010000:00010000:3.0:1788636437.911972:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.911995:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.912002:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00000100:00100000:1.0:1788636437.912005:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963817856 00010000:00010000:3.0:1788636437.912008:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636437.912017:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963817856 00010000:00010000:3.0:1788636437.912020:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.912042:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:3.0:1788636437.912046:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636437.912053:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636437.912060:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ea4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636437.912078:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 179 00000100:00100000:1.0:1788636437.912089:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+42:11531:x1875520963817856:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636437.912124:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636437.912146:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557dd expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.912352:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 42 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.912370:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 42 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.912392:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:1.0:1788636437.912395:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636437.912398:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ac00, rc 0) 00000100:00100000:1.0:1788636437.912500:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43850700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+42:11531:x1875520963817856:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 412us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636437.912508:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 179 00000100:00100000:3.0:1788636437.915504:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636437.915972:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963817984 00000100:00100000:1.0:1788636437.915986:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963817984 00000100:00100000:1.0:1788636437.916063:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 52 00000100:00100000:1.0:1788636437.916078:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2363:x1875520963817984:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788636437.916608:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963817984:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 531us (1114us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788636437.916619:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 52 00000100:00100000:2.0:1788636437.924681:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636437.926193:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963818240 00000100:00100000:3.0:1788636437.926208:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963818240 00000100:00100000:3.0:1788636437.926293:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:3.0:1788636437.926305:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+42:11531:x1875520963818240:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788636437.926634:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+43:11531:x1875520963818240:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 331us (1968us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1788636437.926644:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:3.0:1788636437.930278:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.930367:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963818496 00000100:00100000:0.0:1788636437.930382:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963818496 00000100:00100000:0.0:1788636437.930451:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 180 00000100:00100000:0.0:1788636437.930466:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+43:11531:x1875520963818496:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788636437.931378:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+43:11531:x1875520963818496:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 910us (1108us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636437.931390:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 180 00000100:00100000:3.0:1788636437.936362:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636437.936511:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963818624 00000100:00100000:1.0:1788636437.936525:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963818624 00000100:00100000:1.0:1788636437.936598:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 181 00000100:00100000:1.0:1788636437.936611:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+43:11531:x1875520963818624:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636437.936651:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636437.936682:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7eb2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557e4 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.936777:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7eb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.936939:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.936957:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636437.937280:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636437.937310:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7eb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.937348:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7eb2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557e4 expref: 45 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.937371:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7eb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557e4 expref: 44 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.937382:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:1.0:1788636437.937384:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788636437.937389:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a400, rc 0) 00000100:00100000:1.0:1788636437.937594:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+44:11531:x1875520963818624:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 985us (1247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636437.937603:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 181 00000100:00100000:2.0:1788636437.943163:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636437.943605:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963818752 00000100:00100000:1.0:1788636437.943618:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963818752 00000100:00100000:1.0:1788636437.943744:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 53 00000100:00100000:1.0:1788636437.943757:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963818752:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636437.943791:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636437.943869:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557eb expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636437.943918:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6d16, blocks: 0x1 00010000:00010000:1.0:1788636437.943944:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=306s v=(0 0) 00010000:00010000:1.0:1788636437.943949:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636437.943961:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.943986:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 8 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.944002:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196aa00, rc 0) 00000100:00100000:1.0:1788636437.944095:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963818752:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 340us (947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636437.944103:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 53 00000100:00100000:1.0:1788636437.948155:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636437.948244:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963819008 00000100:00100000:3.0:1788636437.948257:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963819008 00000100:00100000:3.0:1788636437.948334:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 182 00000100:00100000:3.0:1788636437.948348:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+44:11531:x1875520963819008:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636437.948516:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43850000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+44:11531:x1875520963819008:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 170us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636437.948524:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 182 00000100:00100000:2.0:1788636437.952460:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.952526:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963819136 00000100:00100000:0.0:1788636437.952540:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963819136 00000100:00100000:0.0:1788636437.952613:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00100000:0.0:1788636437.952625:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:11531:x1875520963819136:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636437.952666:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636437.952692:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557f2 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.952747:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.952759:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636437.952765:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636437.952771:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.952866:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 9 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636437.952896:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 9 pid: 6659 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636437.952918:0:6662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976397184:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636437.953044:0:6662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd51335b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636437.958404:0:6662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976397184:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636437.958453:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 9 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636437.958470:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00010000:00010000:0.0:1788636437.958486:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d200, rc 0) 00000100:00100000:0.0:1788636437.959478:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+9:11531:x1875520963819136:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 6848us (7023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636437.959490:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00100000:1.0:1788636437.961462:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963819264 00000100:00100000:1.0:1788636437.961483:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963819264 00010000:00010000:1.0:1788636437.961552:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 9 pid: 6659 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636437.961636:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 68 00000100:00100000:1.0:1788636437.961649:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+9:2362:x1875520963819264:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636437.961669:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636437.961700:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 9 pid: 6659 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.961717:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 9 pid: 6659 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.961746:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa7ec0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557eb expref: 9 pid: 6659 timeout: 406 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.961766:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636437.961771:0:6675:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636437.961781:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.961791:0:6675:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636437.961922:0:6675:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636437.961940:0:6675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc43851500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6675:1875520976397312:192.168.203.57@tcp:105: 00000100:00100000:1.0:1788636437.962053:0:6675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47efacc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636437.966634:0:6675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc43851500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6675:1875520976397312:192.168.203.57@tcp:105: 00010000:00010000:1.0:1788636437.966676:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636437.966825:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963819264:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 5177us (8360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636437.966838:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 68 00000100:00100000:1.0:1788636437.969346:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636437.971590:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963819392 00000100:00100000:2.0:1788636437.971609:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963819392 00002000:00100000:2.0:1788636437.971684:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9cfc43851500 x1875520963819392/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:678/0 lens 504/0 e 0 to 0 dl 1788636448 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788636437.971698:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfc43851500 with x1875520963819392 ext(0->8) 00002000:00010000:2.0:1788636437.971705:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfc43851500 00000100:00100000:2.0:1788636437.971756:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:2.0:1788636437.971766:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2363:x1875520963819392:12345-192.168.203.57@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788636437.975521:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43851500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+10:2363:x1875520963819392:12345-192.168.203.57@tcp:4:lhsmtool_posix.0 Request processed in 3738us (6170us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788636437.975537:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00002000:00100000:2.0:1788636437.975554:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9cfc43851500 x1875520963819392/t4294967315(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:678/0 lens 504/448 e 0 to 0 dl 1788636448 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788636437.975565:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfc43851500 with x1875520963819392 ext(0->8) 00002000:00010000:2.0:1788636437.975574:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfc43851500 00000100:00100000:3.0:1788636437.987355:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636437.987544:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963819520 00000100:00100000:0.0:1788636437.987558:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963819520 00000100:00100000:0.0:1788636437.987642:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 183 00000100:00100000:0.0:1788636437.987656:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+44:11531:x1875520963819520:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788636438.100947:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967453 is committed 00000001:00080000:3.0:1788636438.101002:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000020:00080000:3.0:1788636438.101032:0:5832:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:3.0:1788636438.101042:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788636438.101050:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:2.0:1788636438.101154:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1788636438.101180:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1788636438.101560:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc43851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976397440:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788636438.101655:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636438.101830:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976397440 00000100:00100000:1.0:1788636438.101839:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976397440 00000100:00100000:1.0:1788636438.101919:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788636438.101931:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976397440:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:2.0:1788636438.102135:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1788636438.102491:0:6963:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788636438.102496:0:6963:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788636438 00002000:00010000:1.0:1788636438.102499:0:6963:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788636438.102501:0:6963:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788636438 -> 1788636438 00002000:00010000:1.0:1788636438.102503:0:6963:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788636438.102571:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3282:x1875520976397440:12345-0@lo:2:osp-syn-1-0.0 Request processed in 642us (915us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788636438.102580:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788636438.102767:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+18:11531:x1875520963819520:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 Request processed in 115112us (115424us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636438.102777:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 183 00000004:00080000:2.0:1788636438.103121:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfc43851880/2, rc 0, transno 4294967316 00000100:00100000:2.0:1788636438.103130:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc43851880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976397440:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788636438.112433:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636438.113903:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963819648 00000100:00100000:2.0:1788636438.113922:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963819648 00000100:00100000:2.0:1788636438.114005:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 56 00000100:00100000:2.0:1788636438.114016:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+10:2361:x1875520963819648:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788636438.144853:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636438.208690:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43853b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+10:2361:x1875520963819648:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 Request processed in 94658us (96253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636438.208707:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 56 00000001:00080000:2.0:1788636438.211948:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:2.0:1788636438.211976:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1788636438.211998:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788636438.215854:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636438.216010:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963819904 00000100:00100000:2.0:1788636438.216022:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963819904 00000100:00100000:2.0:1788636438.216106:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 184 00000100:00100000:2.0:1788636438.216119:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+18:11531:x1875520963819904:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788636438.216489:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636438.216529:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa7eb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557e4 expref: 18 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636438.216549:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:2.0:1788636438.216555:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636438.216605:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636438.216622:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636438.216635:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788636438.216892:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:2.0:1788636438.218973:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f6b671a9 reply state 00000000dff76832 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636438.219051:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636438.222963:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+19:11531:x1875520963819904:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 6828us (7103us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1788636438.222979:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 184 00010000:00010000:3.0:1788636438.225257:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.225275:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.225638:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.225647:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636438.225654:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.225664:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.225687:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:3.0:1788636438.225698:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636438.225705:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.225713:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa7ece lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636438.230526:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636438.230584:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963820032 00000040:00080000:0.0:1788636438.231029:0:12499:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636438.231035:0:12499:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:1.0:1788636438.231114:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963820032 00000100:00100000:1.0:1788636438.231176:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 57 00000100:00100000:1.0:1788636438.231253:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963820032:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00000040:00080000:0.0:1788636438.231438:0:12499:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1788636438.231446:0:12499:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00002000:00010000:1.0:1788636438.233594:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788636438.233606:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788636438 -> 1788636437 00002000:00010000:1.0:1788636438.233610:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788636435 00002000:00010000:1.0:1788636438.233613:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788636438 -> 1788636437 00002000:00010000:1.0:1788636438.233615:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788636438.233714:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43853800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963820032:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 2522us (3196us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788636438.234368:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 57 00000100:00100000:3.0:1788636438.241608:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636438.243882:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963820288 00000100:00100000:0.0:1788636438.243900:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963820288 00000100:00100000:0.0:1788636438.243975:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 185 00000100:00100000:0.0:1788636438.243987:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+18:11531:x1875520963820288:12345-192.168.203.57@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788636438.244079:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.244100:0:7975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 18 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.244110:0:7975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.244181:0:7975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 18 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.244260:0:7975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 18 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636438.244348:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976397568:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636438.244465:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636438.249100:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636438.249146:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963820416 00000100:00100000:1.0:1788636438.249158:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963820416 00010000:00010000:1.0:1788636438.249210:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 19 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636438.249254:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:1.0:1788636438.249267:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+19:2362:x1875520963820416:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636438.249287:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636438.249295:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 19 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.249312:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 19 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.249340:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:1.0:1788636438.249346:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.249753:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7e9d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557d6 expref: 19 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636438.249773:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976397568:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636438.249936:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.249949:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.250161:0:7975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.250967:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636438.251433:0:7975:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.251445:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.251486:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.251494:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.251502:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.251521:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191dc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636438.251527:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.251535:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.251554:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:0.0:1788636438.251558:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788636438.251562:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.251569:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ed5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636438.251682:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+18:11531:x1875520963820288:12345-192.168.203.57@tcp:55:lhsmtool_posix.0 Request processed in 7690us (10082us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788636438.251694:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 185 00000100:00100000:1.0:1788636438.251793:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699a9c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+17:2362:x1875520963820416:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 2526us (2822us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636438.251829:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:3.0:1788636438.258476:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636438.258567:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963820544 00000100:00100000:1.0:1788636438.258582:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963820544 00000100:00100000:1.0:1788636438.258651:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:1.0:1788636438.258663:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:2361:x1875520963820544:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788636438.258716:0:6662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.258740:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.258750:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788636438.258755:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636438.258761:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.258821:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.258851:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 8 pid: 6662 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636438.258871:0:6662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc43851c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976397696:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636438.258985:0:6662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e7f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636438.262241:0:6662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc43851c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976397696:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636438.262279:0:6662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636438.265998:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636438.266069:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963820672 00000100:00100000:0.0:1788636438.266082:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963820672 00010000:00010000:0.0:1788636438.266136:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 9 pid: 6662 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636438.266200:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 70 00000100:00100000:0.0:1788636438.266214:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963820672:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636438.266233:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636438.266262:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 9 pid: 6662 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.266308:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 9 pid: 6662 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.266337:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b061bd4f/0xa6aa59fb12fa7ec7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351557f2 expref: 9 pid: 6662 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.266355:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636438.266360:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636438.266368:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.266380:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.266413:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636438.266482:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43853480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:2363:x1875520963820672:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 272us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636438.266491:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 70 00010000:00010000:3.0:1788636438.266701:0:6662:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.266713:0:6662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.266744:0:6662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.266753:0:6662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.266763:0:6662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.266784:0:6662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636438.266789:0:6662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.266915:0:6662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.266931:0:6662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.266939:0:6662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa7edc lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636438.267012:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963820544:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 Request processed in 8350us (8547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636438.267021:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:1.0:1788636438.271129:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636438.273032:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963820928 00000100:00100000:3.0:1788636438.273051:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963820928 00000100:00100000:3.0:1788636438.273139:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 186 00000100:00100000:3.0:1788636438.273151:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+17:11531:x1875520963820928:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788636438.273273:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.273419:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.273450:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.273711:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.273725:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 18 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.273736:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.273777:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 18 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.275790:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 18 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636438.275840:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976397824:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636438.275983:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd61066b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788636438.283684:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590f480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976397824:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636438.283724:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636438.286899:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636438.286989:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963821056 00000100:00100000:0.0:1788636438.287002:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963821056 00010000:00010000:0.0:1788636438.287053:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 19 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636438.287101:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 71 00000100:00100000:0.0:1788636438.287112:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:2363:x1875520963821056:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636438.287145:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636438.287153:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 19 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.287169:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 19 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.287207:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa7eab lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557dd expref: 19 pid: 7975 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.287223:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:0.0:1788636438.287230:0:5795:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.287241:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.287251:0:5795:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.287388:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636438.287460:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43853100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+18:2363:x1875520963821056:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 349us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636438.287470:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 71 00010000:00010000:0.0:1788636438.287501:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.287510:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636438.287750:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:0.0:1788636438.287956:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1788636438.288004:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:0.0:1788636438.288104:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1875520976397952:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788636438.288176:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636438.288218:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636438.288248:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976397952 00000100:00100000:0.0:1788636438.288254:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976397952 00000100:00100000:0.0:1788636438.288691:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636438.288704:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875520976397952:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788636438.288825:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5810:x1875520976397952:12345-0@lo:1000:mdt00_000.0 Request processed in 122us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636438.288833:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636438.292753:0:5810:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:0.0:1788636438.292769:0:5810:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfc43851880, transno 4294967316 00000100:00100000:0.0:1788636438.292823:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1875520976397952:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788636438.295092:0:5810:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1788636438.296567:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1875520976398080:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788636438.296664:0:5810:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636438.296702:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd000 going to sleep for 11 seconds 00000100:00100000:1.0:1788636438.296861:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976398080 00000100:00100000:1.0:1788636438.296870:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976398080 00000100:00100000:1.0:1788636438.296946:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788636438.296957:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5810:x1875520976398080:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788636438.298618:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5810:x1875520976398080:12345-0@lo:1000:mdt00_000.0 Request processed in 1652us (1944us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788636438.298634:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636438.299152:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c5b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5810:1875520976398080:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788636438.299279:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299356:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299376:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299383:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636438.299389:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299399:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299419:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd42a85100) 00010000:00010000:0.0:1788636438.299423:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636438.299428:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299435:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7eea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299476:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299483:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299489:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299496:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636438.299499:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299517:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299527:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636438.299530:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636438.299533:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299539:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7e26 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299565:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299582:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299592:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299638:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 21 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.299657:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 21 pid: 5810 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636438.299673:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c58380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976398208:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636438.299778:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd000 going to sleep for 11 seconds 00000100:00100000:0.0:1788636438.304295:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c58380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976398208:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636438.304340:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636438.305167:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636438.305317:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963821184 00000100:00100000:1.0:1788636438.305328:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963821184 00010000:00010000:1.0:1788636438.305374:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 22 pid: 5810 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636438.305416:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 72 00000100:00100000:1.0:1788636438.305428:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+22:2362:x1875520963821184:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636438.305446:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636438.305454:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 22 pid: 5810 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.305475:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 22 pid: 5810 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.305501:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7e42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351557c1 expref: 22 pid: 5810 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.305519:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:1.0:1788636438.305526:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.305537:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.305547:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.305580:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636438.305645:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+21:2362:x1875520963821184:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 219us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636438.305652:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 72 00010000:00010000:3.0:1788636438.305686:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305708:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305723:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305730:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305736:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305742:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636438.305747:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305755:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305765:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:3.0:1788636438.305768:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636438.305772:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305787:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7ef1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.305982:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.307277:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.307295:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.307301:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636438.307306:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.307316:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.307333:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:3.0:1788636438.307336:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636438.307340:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636438.307348:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7ee3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788636438.308134:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636438.308141:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788636438.308164:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43850380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+20:11531:x1875520963820928:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 35007us (37041us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788636438.308176:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 186 00000020:00080000:3.0:1788636438.308183:0:5810:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788636438.311532:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788636438.311559:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788636438.318921:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636438.320323:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963821440 00000100:00100000:1.0:1788636438.320340:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963821440 00000100:00100000:1.0:1788636438.320420:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:1.0:1788636438.320431:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd507d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+20:11531:x1875520963821440:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788636438.321661:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788636438.321790:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:1.0:1788636438.322440:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.322468:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.322483:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.322494:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.322501:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.322509:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636438.322539:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788636438.322690:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd507d4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+22:11531:x1875520963821440:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 2254us (3773us total) trans 4294967468 rc 0/0 00000100:00100000:1.0:1788636438.322702:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 50 00000020:00080000:1.0:1788636438.322709:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788636438.323159:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636438.323170:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.323179:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196aa00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636438.323196:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.323208:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.323225:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cfd5a43ce00) 00010000:00010000:0.0:1788636438.323229:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788636438.323235:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.323242:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7ef8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636438.323265:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636438.323267:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636438.323270:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636439.169094:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636439.170065:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976398592:0@lo:400:kworker.0 00000100:00100000:0.0:1788636439.170082:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976398464:0@lo:400:kworker.0 00000100:00100000:1.0:1788636439.170177:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976398336:0@lo:400:kworker.0 00000100:00100000:2.0:1788636439.170189:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976398720:0@lo:400:kworker.0 00000100:00100000:0.0:1788636439.170260:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636439.170373:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788636439.170402:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636439.170472:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976398976 00000100:00100000:0.0:1788636439.170482:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976398976 00000100:00100000:0.0:1788636439.170540:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788636439.170550:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976398976:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636439.170608:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976398976:12345-0@lo:400:kworker.0 Request processed in 58us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636439.170615:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788636439.173053:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976398464 00000100:00100000:3.0:1788636439.173071:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976398464 00000100:00100000:3.0:1788636439.173163:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788636439.173175:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976398464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636439.173305:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976398464:12345-0@lo:400:kworker.0 Request processed in 132us (3045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636439.173313:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788636439.173347:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636439.173444:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976398592 00000100:00100000:3.0:1788636439.173448:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976398592 00000100:00100000:3.0:1788636439.173486:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788636439.173493:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875520976398592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636439.173530:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875520976398592:12345-0@lo:400:kworker.0 Request processed in 38us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636439.173536:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00080000:3.0:1788636439.173552:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636439.173593:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976398592:0@lo:400:kworker.0 00000100:00100000:0.0:1788636439.173950:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976398976:0@lo:400:kworker.0 00000100:00100000:0.0:1788636439.173979:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976398464:0@lo:400:kworker.0 00000100:00100000:1.0:1788636439.177910:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636439.178002:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976398848:0@lo:400:kworker.0 00000100:00100000:1.0:1788636439.178371:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636439.178512:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976398848 00000100:00100000:0.0:1788636439.178523:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976398848 00000100:00100000:0.0:1788636439.178612:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788636439.178624:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976398848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636439.178708:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43851880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976398848:12345-0@lo:400:kworker.0 Request processed in 86us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636439.178717:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788636439.179364:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976398336 00000100:00100000:3.0:1788636439.179372:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976398336 00000100:00100000:3.0:1788636439.179423:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1788636439.179432:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976398336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636439.179487:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976398336:12345-0@lo:400:kworker.0 Request processed in 56us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636439.179494:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:1.0:1788636439.181208:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636439.181275:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976398336:0@lo:400:kworker.0 00000100:00100000:1.0:1788636439.181300:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976398848:0@lo:400:kworker.0 00000100:00100000:2.0:1788636439.183056:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636439.183348:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976398720 00000100:00100000:3.0:1788636439.183360:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976398720 00000100:00100000:3.0:1788636439.183448:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788636439.183460:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976398720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636439.183538:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976398720:12345-0@lo:400:kworker.0 Request processed in 81us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636439.183563:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788636439.183905:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976398720:0@lo:400:kworker.0 00000100:00080000:1.0:1788636439.183988:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636439.679153:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636439.679182:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976399104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636439.679274:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636439.679469:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976399104 00000100:00100000:1.0:1788636439.679481:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976399104 00000100:00100000:1.0:1788636439.679551:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788636439.679563:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976399104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636439.679611:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636439.679684:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976399104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636439.679711:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788636439.679935:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c58a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976399104:0@lo:13:osp-pre-1-0.0 00000001:00080000:1.0:1788636439.795145:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1788636439.795176:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:1.0:1788636440.195528:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636440.298530:0:12551:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636440.298540:0:12551:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636440.301533:0:12551:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788636440.301542:0:12551:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636440.483572:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636440.483735:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963821696 00000100:00100000:3.0:1788636440.483744:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963821696 00000100:00080000:1.0:1788636440.483893:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636440.484099:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 187 00000100:00100000:3.0:1788636440.484112:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+22:11549:x1875520963821696:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636440.484135:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636440.484158:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7eff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351557f9 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.484254:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7f06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.484268:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7f06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.484280:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7f06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636440.484292:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788636440.484414:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7eff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f9 expref: 25 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.484431:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7f06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f9 expref: 24 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.484456:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:3.0:1788636440.484459:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788636440.484463:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c400, rc 0) 00000100:00100000:3.0:1788636440.484704:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+24:11549:x1875520963821696:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 594us (1141us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1788636440.484711:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 187 00000100:00100000:2.0:1788636440.510734:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636440.511148:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963821824 00000100:00100000:3.0:1788636440.511158:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963821824 00000100:00100000:3.0:1788636440.511216:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 188 00000100:00100000:3.0:1788636440.511227:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:11549:x1875520963821824:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:3.0:1788636440.511311:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.511328:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.511341:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.511358:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.511365:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.511372:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512215:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512226:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512235:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636440.512271:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512283:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512290:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512297:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512303:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636440.512308:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512315:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512325:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:3.0:1788636440.512328:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636440.512333:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512346:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f14 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512358:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512364:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512370:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512375:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636440.512377:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512383:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512389:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd42a85700) 00010000:00010000:3.0:1788636440.512391:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636440.512394:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512399:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f1b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512411:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512417:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512426:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512431:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636440.512433:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512439:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512445:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636440.512447:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636440.512450:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.512455:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636440.512529:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5eb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:11549:x1875520963821824:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 1303us (1801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636440.512537:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 188 00000100:00100000:1.0:1788636440.558879:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636440.558916:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963822080 00000100:00100000:1.0:1788636440.558926:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963822080 00000100:00100000:1.0:1788636440.558975:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 189 00000100:00100000:1.0:1788636440.558985:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+24:11552:x1875520963822080:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636440.559004:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636440.559023:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7f29 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155800 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559093:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559108:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559132:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559148:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559155:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559162:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559396:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559406:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559412:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636440.559422:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788636440.559509:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559516:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559522:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559526:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ba00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636440.559536:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559544:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559556:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:1.0:1788636440.559560:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636440.559565:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559572:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa7f30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559596:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559603:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559608:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559613:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636440.559616:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559621:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559628:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd5a43c300) 00010000:00010000:1.0:1788636440.559631:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636440.559640:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559770:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7f37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559837:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa7f29 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 27 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559852:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 26 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.559870:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:1.0:1788636440.559873:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636440.559875:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196bc00, rc 0) 00000100:00100000:1.0:1788636440.559935:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43850a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+26:11552:x1875520963822080:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 951us (1076us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788636440.559943:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 189 00000100:00100000:3.0:1788636440.564172:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636440.564757:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963822208 00000100:00100000:1.0:1788636440.564767:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963822208 00000100:00100000:1.0:1788636440.564836:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 190 00000100:00100000:1.0:1788636440.564847:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+26:11552:x1875520963822208:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:1.0:1788636440.564919:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.564936:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.564947:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.564989:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.564995:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.565002:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.565009:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196aa00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636440.565013:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.565020:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.565031:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:1.0:1788636440.565034:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636440.565039:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.565045:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f4c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636440.565108:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+26:11552:x1875520963822208:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 263us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636440.565116:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 190 00000100:00100000:0.0:1788636440.583251:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636440.590670:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963822464 00000100:00100000:3.0:1788636440.590686:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963822464 00000100:00100000:3.0:1788636440.590748:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 51 00000100:00100000:3.0:1788636440.590759:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+26:11552:x1875520963822464:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636440.591019:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+27:11552:x1875520963822464:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 261us (7776us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788636440.591045:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 51 00000100:00100000:1.0:1788636440.640271:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636440.640386:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963822720 00000100:00100000:0.0:1788636440.640397:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963822720 00000100:00100000:0.0:1788636440.640461:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 191 00000100:00100000:0.0:1788636440.640472:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+27:11078:x1875520963822720:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636440.640508:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636440.640529:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7f53 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155807 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.640642:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.640667:0:7975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.640676:0:7975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.640709:0:7975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.640723:0:7975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 28 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636440.640737:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976399232:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636440.640992:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636440.649781:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636440.650139:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c5a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976399232:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636440.650143:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963822848 00000100:00100000:1.0:1788636440.650167:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963822848 00010000:00010000:0.0:1788636440.650183:0:7975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.650242:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 29 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636440.650292:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 73 00000100:00100000:1.0:1788636440.650304:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+29:2363:x1875520963822848:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636440.650320:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636440.650328:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 29 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.650342:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 29 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.650365:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155800 expref: 29 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.650383:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:1.0:1788636440.650388:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.650398:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.650404:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.650434:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636440.650477:0:7975:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.650488:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636440.650505:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+28:2363:x1875520963822848:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 201us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636440.650522:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 73 00000004:00200000:0.0:1788636440.650548:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:0.0:1788636440.650764:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c200/0xa6aa59fb12fa7f53 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 29 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.650789:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.650849:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:0.0:1788636440.650852:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788636440.650856:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191ce00, rc 0) 00000100:00100000:0.0:1788636440.650918:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43851180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+28:11078:x1875520963822720:12345-192.168.203.57@tcp:101:bash.0 Request processed in 10447us (10776us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1788636440.650927:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 191 00000100:00100000:3.0:1788636440.655096:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636440.655201:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963823104 00000100:00100000:1.0:1788636440.655216:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963823104 00000100:00100000:1.0:1788636440.655285:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 192 00000100:00100000:1.0:1788636440.655295:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+28:11078:x1875520963823104:12345-192.168.203.57@tcp:36:bash.0 00010000:00010000:1.0:1788636440.655560:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.655578:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.655590:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636440.655640:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1788636440.655664:0:5812:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1fc397e reply state 000000009005e023 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636440.655674:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788636440.655720:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1788636440.655848:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+32:11078:x1875520963823104:12345-192.168.203.57@tcp:36:bash.0 Request processed in 553us (764us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1788636440.655856:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 192 00000020:00080000:1.0:1788636440.655871:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788636440.659850:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.659880:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.659889:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.659896:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196aa00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636440.659903:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.659912:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.659960:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:0.0:1788636440.659971:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636440.659978:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.659986:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196aa00/0xa6aa59fb12fa7f68 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636440.660617:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636440.661018:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963823232 00000100:00100000:1.0:1788636440.661029:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963823232 00000100:00100000:1.0:1788636440.661085:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 193 00000100:00100000:1.0:1788636440.661096:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+31:11078:x1875520963823232:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636440.661118:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636440.661137:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515580e expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.661227:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515580e expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.661242:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515580e expref: 32 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.661262:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:1.0:1788636440.661266:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788636440.661270:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196bc00, rc 0) 00000100:00100000:1.0:1788636440.661325:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+32:11078:x1875520963823232:12345-192.168.203.57@tcp:101:bash.0 Request processed in 231us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636440.661331:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 193 00000100:00100000:3.0:1788636440.667669:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636440.667788:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963823360 00000100:00100000:0.0:1788636440.667831:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963823360 00000100:00100000:0.0:1788636440.667931:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00100000:0.0:1788636440.667944:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:11078:x1875520963823360:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636440.667966:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636440.668005:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155815 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788636440.668040:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c6d15, atime: 0x6a9c6d13, ctime: 0x6a9c6d15, blocks: 0xb 00010000:00010000:0.0:1788636440.668067:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=309s v=(0 0) 00010000:00010000:0.0:1788636440.668073:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636440.668083:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.668103:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 8 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636440.668118:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c200, rc 0) 00000100:00100000:0.0:1788636440.668202:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:11078:x1875520963823360:12345-192.168.203.57@tcp:101:bash.0 Request processed in 260us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636440.668225:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00080000:1.0:1788636440.668311:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636440.671514:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636440.671625:0:6667:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963823488 00000100:00100000:3.0:1788636440.671639:0:6667:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963823488 00002000:00010000:3.0:1788636440.671691:0:6667:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788636440.671697:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6f5e8380 with x1875520963823488 ext(0->18446744073709551615) 00002000:00010000:3.0:1788636440.671724:0:6667:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd6f5e8380. 00000100:00100000:3.0:1788636440.671760:0:6667:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:3.0:1788636440.671772:0:6667:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:38630149-ece4-4de3-88b1-a62e16a39489+8:2363:x1875520963823488:12345-192.168.203.57@tcp:10:bash.0 00002000:00010000:3.0:1788636440.672382:0:6667:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788636440.672388:0:6667:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788636437 -> 1788636441 00002000:00010000:3.0:1788636440.672390:0:6667:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788636435 -> 1788636435 00002000:00010000:3.0:1788636440.672392:0:6667:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788636437 -> 1788636441 00002000:00010000:3.0:1788636440.672395:0:6667:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788636440.672494:0:6667:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963823488:12345-192.168.203.57@tcp:10:bash.0 Request processed in 722us (994us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788636440.672503:0:6667:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00002000:00010000:3.0:1788636440.672507:0:6667:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1788636440.672510:0:6667:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6f5e8380 with x1875520963823488 ext(0->18446744073709551615) 00002000:00010000:3.0:1788636440.672515:0:6667:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd6f5e8380. 00000100:00100000:2.0:1788636440.793604:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636440.794054:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963823616 00000100:00100000:3.0:1788636440.794069:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963823616 00000100:00100000:3.0:1788636440.794174:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 194 00000100:00100000:3.0:1788636440.794185:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+32:11566:x1875520963823616:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:3.0:1788636440.794284:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794307:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794322:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794341:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794348:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794354:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794657:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794666:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794674:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636440.794737:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794752:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794765:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794772:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794779:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636440.794784:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794846:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794870:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:3.0:1788636440.794873:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636440.794880:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.794889:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7f7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795069:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795076:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795083:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795089:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636440.795099:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795106:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795114:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636440.795117:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636440.795120:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795126:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f84 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795144:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795150:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795156:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795160:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636440.795163:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795168:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795176:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:3.0:1788636440.795178:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636440.795188:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.795194:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636440.795473:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5eb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+32:11566:x1875520963823616:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 1285us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636440.795483:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 194 00000100:00100000:1.0:1788636440.856748:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636440.856837:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963823872 00000100:00100000:3.0:1788636440.856852:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963823872 00000100:00100000:3.0:1788636440.856928:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 195 00000100:00100000:3.0:1788636440.856939:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+32:11569:x1875520963823872:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636440.856958:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636440.856994:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f92 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515581c expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857067:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857082:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857094:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857111:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857119:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857144:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857398:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7fa7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857407:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857415:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7fa7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636440.857424:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788636440.857526:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857535:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857541:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857546:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636440.857550:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857557:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857569:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:3.0:1788636440.857572:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636440.857583:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857590:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7f99 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857603:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857609:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857614:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857619:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636440.857621:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857626:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.857632:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636440.857634:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636440.859065:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.859080:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fa0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.859142:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7f92 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515581c expref: 35 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.859298:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7fa7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515581c expref: 34 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636440.859306:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:3.0:1788636440.859309:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788636440.859312:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d000, rc 0) 00000100:00100000:3.0:1788636440.859386:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43852d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+34:11569:x1875520963823872:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 2448us (2663us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1788636440.859394:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 195 00000100:00100000:2.0:1788636440.862989:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636440.863102:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963824000 00000100:00100000:1.0:1788636440.863115:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963824000 00000100:00100000:1.0:1788636440.863242:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 196 00000100:00100000:1.0:1788636440.863256:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+34:11569:x1875520963824000:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:1.0:1788636440.863362:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.863384:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 34 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.863395:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.863473:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 34 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.863491:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 34 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636440.863509:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc43852a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976399360:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636440.863644:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd59dddc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636440.872127:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc43852a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976399360:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636440.872168:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636440.874287:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636440.874415:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963824256 00000100:00100000:3.0:1788636440.874428:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963824256 00000100:00100000:3.0:1788636440.875085:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 52 00000100:00100000:3.0:1788636440.875099:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+35:5598:x1875520963824256:12345-192.168.203.57@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788636440.875538:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+36:5598:x1875520963824256:12345-192.168.203.57@tcp:35:ldlm_bl.0 Request processed in 441us (1265us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788636440.875547:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 52 00000100:00100000:2.0:1788636440.880256:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636440.880365:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963824384 00000100:00100000:1.0:1788636440.880378:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963824384 00010000:00010000:1.0:1788636440.880431:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 36 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636440.880523:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 74 00000100:00100000:1.0:1788636440.880535:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+36:2363:x1875520963824384:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636440.880556:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636440.880565:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 36 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.880581:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 36 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.880644:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ce00/0xa6aa59fb12fa7f5a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155807 expref: 36 pid: 7975 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.880665:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:1.0:1788636440.880671:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.880683:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.880692:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636440.880747:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636440.880874:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+35:2363:x1875520963824384:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 340us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636440.880882:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 74 00010000:00010000:2.0:1788636440.881149:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636440.881158:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636440.881212:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636440.881221:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636440.881228:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636440.881235:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636440.881240:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636440.881248:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636440.881260:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:2.0:1788636440.881263:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636440.881268:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636440.881274:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa7fb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636440.881324:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+34:11569:x1875520963824000:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 18072us (18350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636440.881334:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 196 00000100:00100000:2.0:1788636440.887779:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636440.887926:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963824640 00000100:00100000:3.0:1788636440.887939:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963824640 00000100:00100000:3.0:1788636440.888014:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 53 00000100:00100000:3.0:1788636440.888025:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+34:11569:x1875520963824640:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636440.888350:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+35:11569:x1875520963824640:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 326us (585us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1788636440.888360:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 53 00000100:00100000:2.0:1788636441.003625:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636441.003901:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963824896 00000100:00100000:0.0:1788636441.003917:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963824896 00000100:00100000:0.0:1788636441.004006:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 197 00000100:00100000:0.0:1788636441.004019:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+35:11579:x1875520963824896:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:0.0:1788636441.004053:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636441.004082:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7fbc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155823 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004184:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004203:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004220:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004238:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004246:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004253:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004608:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7fd1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004641:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004651:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7fd1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636441.004665:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1788636441.004889:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004899:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004907:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004914:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636441.004920:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004930:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004947:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636441.004951:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636441.004958:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004965:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa7fc3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004982:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.004997:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.005003:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.005008:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636441.005011:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.005017:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.005025:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636441.005028:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636441.005031:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.005038:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa7fca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.005088:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7fbc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155823 expref: 38 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.005103:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7fd1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155823 expref: 37 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.005112:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:0.0:1788636441.005115:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636441.005124:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c800, rc 0) 00000100:00100000:0.0:1788636441.005213:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+37:11579:x1875520963824896:12345-192.168.203.57@tcp:101:cat.0 Request processed in 1196us (1615us total) trans 4294967479 rc 0/0 00000100:00100000:0.0:1788636441.005223:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 197 00000100:00100000:2.0:1788636441.013418:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.013722:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963825152 00000100:00100000:3.0:1788636441.013752:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963825152 00000100:00100000:3.0:1788636441.013850:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00100000:3.0:1788636441.013872:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+37:11579:x1875520963825152:12345-192.168.203.57@tcp:35:cat.0 00000100:00100000:3.0:1788636441.014525:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+38:11579:x1875520963825152:12345-192.168.203.57@tcp:35:cat.0 Request processed in 651us (1118us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788636441.014535:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 54 00000100:00100000:2.0:1788636441.064234:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.064335:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963825408 00000100:00100000:3.0:1788636441.064349:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963825408 00000100:00100000:3.0:1788636441.064423:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 198 00000100:00100000:3.0:1788636441.064435:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+38:11581:x1875520963825408:12345-192.168.203.57@tcp:36:rm.0 00010000:00010000:3.0:1788636441.064525:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788636441.064563:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa7fd1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155823 expref: 38 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.064592:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa7fa7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515581c expref: 37 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.064607:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa7f6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515580e expref: 36 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.064619:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd5a43c500) 00010000:00010000:3.0:1788636441.064632:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636441.064661:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.064679:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.064722:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.064747:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.064754:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.064761:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.065424:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.065434:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.065443:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636441.079448:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788636441.079469:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 310103672637ns, next at 311103667051ns, rc = 0 00010000:00010000:2.0:1788636441.079579:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.079601:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.079616:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.079627:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.079634:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.079641:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080304:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636441.080342:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080350:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080357:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080364:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636441.080369:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080392:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080409:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd42a85700) 00010000:00010000:2.0:1788636441.080412:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788636441.080418:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080429:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa7fed lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080456:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080463:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080469:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080474:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636441.080476:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080482:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080490:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636441.080492:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636441.080495:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.080511:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa7fdf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636441.080526:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5a3a19a reply state 000000007602cf59 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636441.080536:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636441.080659:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+37:11581:x1875520963825408:12345-192.168.203.57@tcp:36:rm.0 Request processed in 16221us (16434us total) trans 4294967481 rc 0/0 00000100:00100000:2.0:1788636441.080669:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 198 00010000:00010000:3.0:1788636441.086094:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.086117:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.086125:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.086131:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636441.086137:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.086165:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.086186:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636441.086189:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636441.086196:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.086202:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa7fe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.088972:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636441.088994:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.089013:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636441.089019:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.089032:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.089055:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cfd42a85700) 00010000:00010000:0.0:1788636441.089059:0:5799:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788636441.089069:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.089077:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa7ff4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.089112:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636441.089114:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636441.089116:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636441.159900:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636441.160169:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963825664 00000100:00100000:0.0:1788636441.160182:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963825664 00000100:00100000:0.0:1788636441.160261:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 199 00000100:00100000:0.0:1788636441.160273:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+36:11587:x1875520963825664:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636441.160302:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636441.160346:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ffb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515582a expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.160497:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.160514:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.160528:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.160543:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.160550:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.160556:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788636441.162374:0:7975:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788636441.162602:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.162631:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.162642:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.162687:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.163106:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.163114:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.163120:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636441.163125:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.163134:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.163150:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:1.0:1788636441.163154:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636441.163160:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.163166:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa8002 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788636441.163182:0:7975:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d16c44f9 reply state 00000000be761751 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.163191:0:7975:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788636441.163235:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa7ffb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 39 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.163252:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 38 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.163270:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:1.0:1788636441.163273:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636441.163275:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ba00, rc 0) 00000100:00100000:1.0:1788636441.163438:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+39:11587:x1875520963825664:12345-192.168.203.57@tcp:101:bash.0 Request processed in 3165us (3560us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788636441.163448:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 199 00000100:00100000:3.0:1788636441.170359:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636441.170542:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963825792 00000100:00100000:2.0:1788636441.170554:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963825792 00000100:00100000:2.0:1788636441.170641:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 60 00000100:00100000:2.0:1788636441.170654:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963825792:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:2.0:1788636441.170676:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636441.170714:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155831 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636441.170753:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636441.170778:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=310s v=(0 0) 00010000:00010000:2.0:1788636441.170783:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636441.170810:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.170834:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 6 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.170883:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea000, rc 0) 00000100:00100000:2.0:1788636441.170971:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2361:x1875520963825792:12345-192.168.203.57@tcp:101:bash.0 Request processed in 310us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636441.170978:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 60 00000100:00080000:3.0:1788636441.171482:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788636441.172475:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.172493:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.172501:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.172508:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636441.172514:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.172523:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.172544:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd500eb200) 00010000:00010000:1.0:1788636441.172548:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636441.172554:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.172561:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa8009 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636441.177090:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636441.177365:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963825920 00000100:00100000:1.0:1788636441.177378:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963825920 00000100:00100000:1.0:1788636441.177543:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:1.0:1788636441.177556:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:11587:x1875520963825920:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636441.177578:0:6659:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636441.177601:0:6659:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155838 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.177651:0:6659:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.177662:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636441.177668:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636441.177674:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.178059:0:6659:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 7 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.178076:0:6659:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 7 pid: 6661 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.178093:0:6659:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc43852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1875520976399488:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636441.178215:0:6659:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd59ddd0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636441.186793:0:6659:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc43852a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6659:1875520976399488:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636441.186905:0:6659:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 7 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.186933:0:6659:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a400, rc 0) 00000100:00100000:0.0:1788636441.187324:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636441.187576:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:11587:x1875520963825920:12345-192.168.203.57@tcp:101:bash.0 Request processed in 10020us (10964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636441.187587:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:1.0:1788636441.187656:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963826048 00000100:00100000:1.0:1788636441.187664:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963826048 00010000:00010000:1.0:1788636441.187698:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 7 pid: 6661 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.187733:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 75 00000100:00100000:1.0:1788636441.187744:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963826048:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636441.187762:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636441.187789:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 7 pid: 6661 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.187830:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 7 pid: 6661 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.187866:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073aa18c8/0xa6aa59fb12fa801e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155831 expref: 7 pid: 6661 timeout: 410 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.187881:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636441.187895:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636441.187905:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.187916:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.187957:0:5795:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.187974:0:5795:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc43852a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1875520976399616:192.168.203.57@tcp:105: 00000100:00100000:1.0:1788636441.196636:0:5795:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd59ddd0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636441.201588:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636441.201723:0:5795:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc43852a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5795:1875520976399616:192.168.203.57@tcp:105: 00010000:00010000:1.0:1788636441.201756:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636441.201876:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963826048:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 14132us (14551us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636441.201898:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 75 00000100:00100000:0.0:1788636441.202126:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963826304 00000100:00100000:0.0:1788636441.202136:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963826304 00000100:00100000:0.0:1788636441.202196:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 55 00000100:00100000:0.0:1788636441.202208:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+38:11587:x1875520963826304:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:0.0:1788636441.203520:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+39:11587:x1875520963826304:12345-192.168.203.57@tcp:35:bash.0 Request processed in 1305us (1937us total) trans 4294967483 rc 0/0 00000100:00100000:0.0:1788636441.203532:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 55 00010000:00010000:3.0:1788636441.215207:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636441.215698:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636441.215737:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976399744:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636441.215866:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636441.215990:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976399744 00000100:00100000:3.0:1788636441.216001:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976399744 00000100:00100000:3.0:1788636441.216075:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788636441.216086:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976399744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636441.216132:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636441.216194:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43852a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976399744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636441.216201:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:1.0:1788636441.216676:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636441.216722:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788636441.216736:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788636441.216761:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd610e8e00, transno 4294967307 00000100:00100000:1.0:1788636441.216792:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c59f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976399744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636441.499632:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636441.503057:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963826432 00000100:00100000:1.0:1788636441.503106:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963826432 00000100:00100000:1.0:1788636441.503207:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 200 00000100:00100000:1.0:1788636441.503220:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+39:11603:x1875520963826432:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636441.503253:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636441.503282:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa802c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515583f expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.503370:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8033 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.503389:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.503405:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636441.503454:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788636441.503459:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636441.503484:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8033 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.503513:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa802c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515583f expref: 41 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.503535:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8033 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515583f expref: 40 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.503544:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:1.0:1788636441.503547:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788636441.503551:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ae00, rc 0) 00000100:00100000:1.0:1788636441.503655:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+40:11603:x1875520963826432:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 438us (4032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636441.503663:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 200 00000100:00100000:2.0:1788636441.518133:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.518236:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963826688 00000100:00100000:3.0:1788636441.518248:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963826688 00000100:00100000:3.0:1788636441.518322:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 201 00000100:00100000:3.0:1788636441.518335:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+40:11603:x1875520963826688:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636441.518365:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636441.518393:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa803a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155846 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.518545:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8041 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.518562:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.518576:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8041 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636441.518589:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788636441.518764:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa803a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155846 expref: 43 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.518787:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8041 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155846 expref: 42 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.518863:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:3.0:1788636441.518867:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636441.518872:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd820fdc00, rc 0) 00000100:00100000:3.0:1788636441.518957:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+42:11603:x1875520963826688:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 624us (836us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788636441.518964:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 201 00000100:00100000:0.0:1788636441.528318:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636441.528845:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636441.528976:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963827072 00000100:00100000:2.0:1788636441.528986:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963827072 00000100:00100000:2.0:1788636441.529050:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:2.0:1788636441.529060:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+42:2363:x1875520963827072:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636441.529076:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636441.529100:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8041 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155846 expref: 42 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.529120:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:2.0:1788636441.529125:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636441.529189:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699aa850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+41:2363:x1875520963827072:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 131us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636441.529197:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:1.0:1788636441.535354:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963826944 00000100:00100000:1.0:1788636441.535370:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963826944 00000100:00100000:1.0:1788636441.535484:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 202 00000100:00100000:1.0:1788636441.535496:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+41:11603:x1875520963826944:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636441.535521:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636441.535542:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa804f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515584d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.537486:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8056 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.537505:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8056 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.537516:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8056 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636441.537530:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788636441.537656:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b600/0xa6aa59fb12fa804f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515584d expref: 44 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.537674:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8056 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515584d expref: 43 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.537683:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:1.0:1788636441.537686:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788636441.538583:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ac00, rc 0) 00000100:00100000:1.0:1788636441.538710:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+43:11603:x1875520963826944:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 3205us (10389us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788636441.538720:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 202 00000100:00100000:0.0:1788636441.567517:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636441.567774:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963827200 00000100:00100000:2.0:1788636441.567784:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963827200 00000100:00100000:2.0:1788636441.567880:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 62 00000100:00100000:2.0:1788636441.567892:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+6:2362:x1875520963827200:12345-192.168.203.57@tcp:1:lfs.0 00010000:00010000:2.0:1788636441.568200:0:6661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.568222:0:6661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.568231:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636441.568235:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788636441.568239:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.568284:0:6661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 6 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.568298:0:6661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 6 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636441.568312:0:6661:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1875520976399872:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636441.568400:0:6661:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc439eef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636441.572317:0:6661:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5ead80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6661:1875520976399872:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636441.572352:0:6661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636441.578224:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636441.578606:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963827328 00000100:00100000:2.0:1788636441.578619:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963827328 00002000:00100000:2.0:1788636441.578686:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cfc41c58000 x1875520963827328/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:682/0 lens 504/0 e 0 to 0 dl 1788636452 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788636441.578724:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfc41c58000 with x1875520963827328 ext(0->8) 00010000:00010000:2.0:1788636441.578737:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 7 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.578768:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 7 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636441.578779:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cfc41c58000 00000100:00100000:2.0:1788636441.578868:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:2.0:1788636441.578879:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963827328:12345-192.168.203.57@tcp:4:lfs.0 00000100:00100000:2.0:1788636441.580278:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963827328:12345-192.168.203.57@tcp:4:lfs.0 Request processed in 1391us (2060us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788636441.580291:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 3 00002000:00100000:2.0:1788636441.580303:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cfc41c58000 x1875520963827328/t4294967308(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:682/0 lens 504/448 e 0 to 0 dl 1788636452 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788636441.580314:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfc41c58000 with x1875520963827328 ext(0->8) 00010000:00010000:2.0:1788636441.580324:0:6665:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 9 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.581868:0:6665:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 9 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636441.581887:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9cfc41c58000 00000100:00100000:0.0:1788636441.590599:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636441.590746:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963827456 00000100:00100000:1.0:1788636441.590760:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963827456 00010000:00010000:1.0:1788636441.590861:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 9 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.590908:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 76 00000100:00100000:1.0:1788636441.590921:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+9:2362:x1875520963827456:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636441.590947:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788636441.590985:0:5796:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788636441.590989:0:5796:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788636441 00002000:00010000:1.0:1788636441.590992:0:5796:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788636441 00002000:00010000:1.0:1788636441.590995:0:5796:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788636441 00010000:00010000:1.0:1788636441.591003:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 9 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.591020:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 9 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.591050:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000399e4450/0xa6aa59fb12fa8025 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155838 expref: 9 pid: 6659 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.591073:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636441.591079:0:5796:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636441.591106:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.591119:0:5796:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.591162:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636441.591240:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963827456:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 322us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636441.591248:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 76 00010000:00010000:2.0:1788636441.592514:0:6661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.592545:0:6661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.592588:0:6661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.592599:0:6661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.592609:0:6661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.592617:0:6661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636441.592622:0:6661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.592631:0:6661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.592648:0:6661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.592657:0:6661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8064 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636441.592788:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963827200:12345-192.168.203.57@tcp:1:lfs.0 Request processed in 24895us (25277us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636441.592841:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 62 00000100:00100000:0.0:1788636441.599648:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.599973:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963827712 00000100:00100000:3.0:1788636441.599986:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963827712 00000100:00100000:3.0:1788636441.600114:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 56 00000100:00100000:3.0:1788636441.600125:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd507d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+43:11603:x1875520963827712:12345-192.168.203.57@tcp:35:lfs.0 00000004:00010000:3.0:1788636441.600204:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8056 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515584d expref: 43 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636441.600699:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1788636441.600757:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1788636441.602535:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1788636441.602640:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.602666:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 47 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.602677:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.602726:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 47 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.603202:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 47 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636441.603225:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1875520976400000:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636441.603475:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd50bd7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788636441.609979:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636441.610087:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963827840 00000100:00100000:2.0:1788636441.610100:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963827840 00010000:00010000:2.0:1788636441.610156:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 48 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636441.610204:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 77 00000100:00100000:2.0:1788636441.610215:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+48:2363:x1875520963827840:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636441.610234:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636441.610243:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 48 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.610259:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 48 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.610288:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:2.0:1788636441.610294:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.610306:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.610314:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.610371:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636441.610443:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+48:2363:x1875520963827840:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 229us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636441.610452:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 77 00010000:00010000:1.0:1788636441.613084:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa8010 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515582a expref: 47 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.613118:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5814:1875520976400000:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636441.613149:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.616908:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.616930:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636441.617217:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:0.0:1788636441.617695:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:0.0:1788636441.618103:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976400128:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636441.618192:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636441.618302:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1cd180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636441.618411:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976400128 00000100:00100000:2.0:1788636441.618421:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976400128 00000100:00100000:2.0:1788636441.618529:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636441.618541:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976400128:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788636441.618679:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976400128:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 139us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636441.618687:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636441.618983:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976400128:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788636441.619913:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1788636441.620062:0:5814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976400256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788636441.620124:0:5814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636441.621146:0:5814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e13d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636441.625496:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976400256 00000100:00100000:2.0:1788636441.625520:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976400256 00000100:00100000:2.0:1788636441.625600:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636441.625704:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1875520976400256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788636441.626664:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5814:x1875520976400256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 1048us (6533us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788636441.626677:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788636441.627097:0:5814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c5bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5814:1875520976400256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788636441.627206:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:0.0:1788636441.627278:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.627291:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.627320:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.627328:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636441.627334:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.627421:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.629189:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:0.0:1788636441.629204:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788636441.629218:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636441.629231:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa806b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636441.630067:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788636441.630228:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788636441.630243:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 310654446263ns, next at 311654442782ns, rc = 0 00000001:00080000:0.0:1788636441.630256:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:0.0:1788636441.630325:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd5a43c300) 00010000:00010000:0.0:1788636441.630329:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788636441.630353:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8056 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515584d expref: 51 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636441.630526:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd507d5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+50:11603:x1875520963827712:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 30402us (30892us total) trans 4294967494 rc 0/0 00000100:00100000:0.0:1788636441.630550:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 56 00000020:00080000:0.0:1788636441.630558:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788636441.632617:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.633098:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963827968 00000100:00100000:3.0:1788636441.633111:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963827968 00000100:00100000:3.0:1788636441.633182:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 203 00000100:00100000:3.0:1788636441.633195:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+50:11603:x1875520963827968:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636441.633224:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636441.633255:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa8072 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155854 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.633354:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa8072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155854 expref: 51 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.633372:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa8072 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155854 expref: 51 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.633396:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636441.633400:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636441.633404:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd820fc600, rc 0) 00000100:00100000:3.0:1788636441.633475:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+51:11603:x1875520963827968:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 283us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636441.633482:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 203 00000100:00100000:3.0:1788636441.637746:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636441.637929:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963828224 00000100:00100000:0.0:1788636441.637942:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963828224 00000100:00100000:0.0:1788636441.638024:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 57 00000100:00100000:0.0:1788636441.638037:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+51:11603:x1875520963828224:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:0.0:1788636441.638352:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+52:11603:x1875520963828224:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 316us (625us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788636441.638361:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 57 00000100:00100000:0.0:1788636441.750791:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636441.751499:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963828352 00000100:00100000:2.0:1788636441.751515:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963828352 00000100:00100000:2.0:1788636441.751592:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 204 00000100:00100000:2.0:1788636441.751604:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+52:11614:x1875520963828352:12345-192.168.203.57@tcp:34:lfs.0 00010000:00010000:2.0:1788636441.751706:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.751739:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.751773:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.751792:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.751826:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.751833:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752061:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752071:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752078:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636441.752130:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752144:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752151:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752158:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752175:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636441.752180:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752188:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752202:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636441.752205:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636441.752211:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752218:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8079 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752236:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752243:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752254:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752259:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636441.752262:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752268:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752287:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd62575600) 00010000:00010000:2.0:1788636441.752290:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636441.752293:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752300:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa8080 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752317:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752322:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752327:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752332:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636441.752334:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752339:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752347:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636441.752349:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636441.752353:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.752358:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8087 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636441.752716:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+52:11614:x1875520963828352:12345-192.168.203.57@tcp:34:lfs.0 Request processed in 1111us (1941us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636441.752725:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 204 00000100:00100000:2.0:1788636441.828319:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.828423:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963828608 00000100:00100000:3.0:1788636441.828436:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963828608 00000100:00100000:3.0:1788636441.828516:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 205 00000100:00100000:3.0:1788636441.828529:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+52:11617:x1875520963828608:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636441.828557:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636441.828584:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa808e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515585b expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.828683:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.828702:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.828752:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.828780:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.828788:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.828839:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829241:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829251:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829259:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636441.829272:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788636441.829402:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829411:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829419:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829425:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636441.829430:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829439:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829455:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636441.829467:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636441.829474:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829482:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8095 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829502:0:5810:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829509:0:5810:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829514:0:5810:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829519:0:5810:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fdc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636441.829522:0:5810:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829528:0:5810:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829537:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd42a85800) 00010000:00010000:2.0:1788636441.829540:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636441.829542:0:5810:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829548:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa809c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829598:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa808e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829627:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 54 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.829636:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636441.829639:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636441.829641:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb800, rc 0) 00000100:00100000:2.0:1788636441.829724:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+54:11617:x1875520963828608:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1197us (1419us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1788636441.829733:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 205 00000100:00100000:3.0:1788636441.837649:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636441.838565:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963828736 00000100:00100000:1.0:1788636441.838579:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963828736 00000100:00100000:1.0:1788636441.838720:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 206 00000100:00100000:1.0:1788636441.838734:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+54:11617:x1875520963828736:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:1.0:1788636441.838859:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.838882:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.838906:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.839025:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.839035:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.839044:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.839051:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ba00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636441.839056:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.839065:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.839081:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:1.0:1788636441.839084:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636441.839090:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.839097:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.839203:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+54:11617:x1875520963828736:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 473us (1568us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636441.839211:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 206 00000100:00100000:0.0:1788636441.842373:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.842768:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963828992 00000100:00100000:3.0:1788636441.842783:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963828992 00000100:00100000:3.0:1788636441.842880:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:3.0:1788636441.842903:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+54:11617:x1875520963828992:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636441.843198:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f925500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+55:11617:x1875520963828992:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 298us (837us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788636441.843207:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 58 00000100:00100000:0.0:1788636441.939141:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636441.939242:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963829248 00000100:00100000:1.0:1788636441.939255:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963829248 00000100:00100000:1.0:1788636441.939325:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 207 00000100:00100000:1.0:1788636441.939355:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+55:11627:x1875520963829248:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636441.939384:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636441.939387:0:7975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788636441.939418:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8033 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515583f expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.939441:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:1.0:1788636441.939447:0:7975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788636441.939462:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155862 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.939582:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.939596:0:7975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.939605:0:7975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.939641:0:7975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 55 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.939656:0:7975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 55 pid: 5810 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.939671:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc43852680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976400384:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636441.939780:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd59dddc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636441.946616:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.946710:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963829376 00000100:00100000:3.0:1788636441.946731:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963829376 00010000:00010000:3.0:1788636441.946781:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 56 pid: 5810 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636441.946869:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 78 00000100:00100000:3.0:1788636441.946879:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+56:2362:x1875520963829376:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636441.946926:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636441.946934:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 56 pid: 5810 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.946948:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 56 pid: 5810 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.946984:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636441.946991:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.947003:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.947011:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.947035:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636441.947102:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+56:2362:x1875520963829376:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 224us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636441.947111:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 78 00010000:00010000:1.0:1788636441.947763:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515585b expref: 55 pid: 5810 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.947785:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc43852680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976400384:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636441.947860:0:7975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.947871:0:7975:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.947886:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636441.947909:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788636441.949360:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ba00/0xa6aa59fb12fa80b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 56 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.949386:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 55 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.949396:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:1.0:1788636441.949399:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788636441.949403:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a400, rc 0) 00000100:00100000:1.0:1788636441.949487:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f925880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+55:11627:x1875520963829248:12345-192.168.203.57@tcp:101:bash.0 Request processed in 10133us (10357us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1788636441.949497:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 207 00000100:00100000:2.0:1788636441.953836:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636441.954114:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963829632 00000100:00100000:1.0:1788636441.954128:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963829632 00000100:00100000:1.0:1788636441.954204:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 208 00000100:00100000:1.0:1788636441.954229:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+55:11627:x1875520963829632:12345-192.168.203.57@tcp:36:bash.0 00010000:00010000:1.0:1788636441.954584:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.954606:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636441.954622:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636441.954685:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788636441.954713:0:5811:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bdca846d reply state 000000003f0b5fa8 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636441.954723:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788636441.954926:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5eaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+58:11627:x1875520963829632:12345-192.168.203.57@tcp:36:bash.0 Request processed in 698us (1144us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788636441.954935:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 208 00000020:00080000:1.0:1788636441.954941:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788636441.972776:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636441.973018:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963829760 00000100:00100000:2.0:1788636441.973032:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963829760 00000100:00100000:2.0:1788636441.973109:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 209 00000100:00100000:2.0:1788636441.973122:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+58:11627:x1875520963829760:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:2.0:1788636441.973154:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636441.973184:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155869 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.973303:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.973322:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 59 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.973331:0:5810:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.973353:0:5810:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 5/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.973375:0:5810:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.973407:0:5810:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 59 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.973424:0:5810:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 59 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636441.973442:0:5810:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976400512:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636441.973552:0:5810:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc439eef00 going to sleep for 11 seconds 00010000:00010000:3.0:1788636441.973836:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.973847:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.973863:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.973893:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ae00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636441.973898:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.973908:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.973927:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636441.973931:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636441.973934:0:3267:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.973945:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.973952:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa80cd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636441.981660:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636441.981898:0:5810:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5ea300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5810:1875520976400512:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636441.981939:0:5810:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636441.982076:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963829888 00000100:00100000:3.0:1788636441.982084:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963829888 00010000:00010000:3.0:1788636441.982130:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 59 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636441.982176:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 79 00000100:00100000:3.0:1788636441.982187:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+59:2363:x1875520963829888:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636441.982215:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636441.982224:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 59 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.982261:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 59 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.982291:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a400/0xa6aa59fb12fa80bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155862 expref: 59 pid: 7975 timeout: 410 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.982311:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636441.982317:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.982327:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.982337:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636441.982369:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636441.982443:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f927800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+58:2363:x1875520963829888:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 257us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636441.982452:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 79 00010000:00010000:2.0:1788636441.983340:0:5810:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.983351:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636441.983413:0:5810:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788636441.983419:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636441.983447:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.983501:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 58 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.983522:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 57 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636441.983531:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636441.983534:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636441.983538:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ebc00, rc 0) 00000100:00100000:2.0:1788636441.983595:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f927b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+57:11627:x1875520963829760:12345-192.168.203.57@tcp:101:bash.0 Request processed in 10474us (10834us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636441.983603:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 209 00000100:00100000:0.0:1788636441.994954:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636441.995361:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963830144 00000100:00100000:3.0:1788636441.995374:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963830144 00000100:00100000:2.0:1788636441.997227:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00100000:2.0:1788636441.997243:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+57:11627:x1875520963830144:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:2.0:1788636441.997583:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+58:11627:x1875520963830144:12345-192.168.203.57@tcp:35:bash.0 Request processed in 342us (2640us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1788636441.997591:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 59 00000100:00100000:1.0:1788636442.084741:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.085001:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963830272 00000100:00100000:2.0:1788636442.085014:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963830272 00000100:00100000:2.0:1788636442.085114:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 210 00000100:00100000:2.0:1788636442.085128:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+58:11633:x1875520963830272:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636442.085162:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636442.085190:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80e2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155870 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.085309:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa80e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.085329:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa80e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.085344:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa80e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636442.085390:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788636442.085394:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636442.085416:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa80e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.085443:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa80e2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155870 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.085469:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa80e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155870 expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.085479:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636442.085482:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636442.085486:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb000, rc 0) 00000100:00100000:2.0:1788636442.085566:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43852680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+59:11633:x1875520963830272:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 442us (854us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636442.085574:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 210 00000100:00080000:1.0:1788636442.086134:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636442.092928:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.093038:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963830400 00000100:00100000:2.0:1788636442.093052:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963830400 00000100:00100000:2.0:1788636442.093144:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 211 00000100:00100000:2.0:1788636442.093158:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+59:11633:x1875520963830400:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636442.093187:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636442.093214:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa80f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155877 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093301:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093322:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093337:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093357:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093365:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093372:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093485:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8105 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093494:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093501:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636442.093558:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788636442.093563:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636442.093586:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093601:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8105 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093611:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093619:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093627:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093634:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636442.093638:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093646:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093661:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636442.093664:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636442.093669:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093675:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa80f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093703:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093709:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093715:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093720:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636442.093722:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093729:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093737:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd62575600) 00010000:00010000:2.0:1788636442.093739:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636442.093742:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093747:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa80fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093784:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa80f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155877 expref: 61 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093829:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8105 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155877 expref: 60 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.093862:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636442.093865:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636442.093868:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea000, rc 0) 00000100:00100000:2.0:1788636442.094182:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43853480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+60:11633:x1875520963830400:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1026us (1266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636442.094191:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 211 00000100:00100000:0.0:1788636442.108946:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.109000:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636442.109162:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963830656 00000100:00100000:3.0:1788636442.109174:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963830656 00000100:00100000:3.0:1788636442.109243:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 212 00000100:00100000:3.0:1788636442.109256:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+60:11633:x1875520963830656:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636442.109282:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636442.109311:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa810c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515587e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636442.109422:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963830784 00000100:00100000:1.0:1788636442.109429:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963830784 00010000:00010000:3.0:1788636442.109469:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636442.109480:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 15 00010000:00010000:3.0:1788636442.109488:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 62 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636442.109493:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+62:2363:x1875520963830784:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636442.109505:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8105 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155877 expref: 62 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.109510:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636442.109516:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.112820:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:1.0:1788636442.112838:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.112892:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.112900:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636442.113004:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f924380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+62:2363:x1875520963830784:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 3507us (3995us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636442.113017:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 15 00010000:00010000:3.0:1788636442.113381:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8105 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155877 expref: 61 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.113645:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 60 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.113664:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 60 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636442.113680:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f927100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976400768:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636442.113780:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd50bd7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636442.118023:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.118189:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f927100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976400768:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636442.118230:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636442.118424:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963830912 00000100:00100000:3.0:1788636442.118433:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963830912 00010000:00010000:3.0:1788636442.118476:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 61 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636442.118519:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 80 00000100:00100000:3.0:1788636442.118529:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+61:2362:x1875520963830912:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636442.118547:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636442.118554:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 61 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.118566:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 61 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.118610:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa80db lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155869 expref: 61 pid: 5810 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.118631:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636442.118636:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.118647:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.118656:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.118683:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636442.118824:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.118833:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636442.118865:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788636442.119058:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa810c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 62 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.119075:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.119082:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636442.119085:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636442.119088:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd820fdc00, rc 0) 00000100:00100000:3.0:1788636442.119152:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f924a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+61:2362:x1875520963830912:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 623us (1142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636442.119161:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 80 00000100:00100000:2.0:1788636442.120575:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f927480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+60:11633:x1875520963830656:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 11311us (11634us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1788636442.120608:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 212 00000100:00100000:1.0:1788636442.135281:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.135405:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963831168 00000100:00100000:0.0:1788636442.135418:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963831168 00000100:00100000:0.0:1788636442.135500:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:0.0:1788636442.135512:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd699aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+60:11633:x1875520963831168:12345-192.168.203.57@tcp:103:lfs.0 00010000:00010000:0.0:1788636442.135532:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636442.135563:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa8072 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155854 expref: 60 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.135589:0:5795:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636442.135595:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636442.137038:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd699aa450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+59:11633:x1875520963831168:12345-192.168.203.57@tcp:103:lfs.0 Request processed in 1515us (1761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636442.137053:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:1.0:1788636442.139910:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636442.139976:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963831296 00000100:00100000:3.0:1788636442.139989:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963831296 00000100:00100000:3.0:1788636442.140071:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 213 00000100:00100000:3.0:1788636442.140083:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+59:11633:x1875520963831296:12345-192.168.203.57@tcp:58:lfs.0 00010000:00010000:3.0:1788636442.140465:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.140489:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.140503:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636442.140948:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1788636442.141172:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43853100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+59:11633:x1875520963831296:12345-192.168.203.57@tcp:58:lfs.0 Request processed in 1088us (1274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636442.141180:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 213 00000100:00100000:3.0:1788636442.146575:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.146728:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963831424 00000100:00100000:2.0:1788636442.146742:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963831424 00000100:00100000:2.0:1788636442.146859:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 214 00000100:00100000:2.0:1788636442.146871:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+59:11633:x1875520963831424:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636442.146898:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636442.146923:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155885 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.146996:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.147009:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155885 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.147034:0:5811:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.147049:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155885 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.147065:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636442.147069:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636442.147072:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155885 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.147081:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea200, rc 0) 00000100:00100000:1.0:1788636442.147332:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+60:11633:x1875520963831424:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 461us (768us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636442.147340:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 214 00000100:00100000:1.0:1788636442.184209:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.184254:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.184291:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.184343:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.184379:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963831680 00000100:00100000:1.0:1788636442.184392:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963831680 00000100:00100000:1.0:1788636442.184462:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963831808 00000100:00100000:1.0:1788636442.184466:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963831808 00000100:00100000:1.0:1788636442.184504:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 92 00000100:00100000:1.0:1788636442.184514:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963831680:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636442.184601:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f338c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963831680:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 88us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636442.184609:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 92 00000100:00100000:1.0:1788636442.184783:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 93 00000100:00100000:1.0:1788636442.184833:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7eefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2361:x1875520963831808:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636442.184875:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7eefb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2361:x1875520963831808:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 44us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636442.184883:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 93 00000100:00100000:2.0:1788636442.184903:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963831936 00000100:00100000:2.0:1788636442.184910:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963831936 00000100:00080000:1.0:1788636442.184913:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636442.184941:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636442.184981:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 149 00000100:00100000:2.0:1788636442.184992:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc43851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963831936:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636442.185040:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc43851c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2361:x1875520963831936:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 51us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636442.185048:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 149 00000100:00100000:0.0:1788636442.185352:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963831552 00000100:00100000:0.0:1788636442.185357:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963831552 00000100:00100000:0.0:1788636442.185395:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 293 00000100:00100000:0.0:1788636442.185403:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963831552:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636442.185451:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963831552:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 42us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636442.185458:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 293 00010000:00010000:1.0:1788636442.239263:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636442.431336:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636442.431346:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636442.432054:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:2.0:1788636442.432062:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788636442.432390:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5ea300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976400896:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788636442.434366:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc439ee540 going to sleep for 11 seconds 00000100:00100000:1.0:1788636442.446238:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.446561:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5ea300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976400896:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636442.446955:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963832064 00000100:00100000:0.0:1788636442.446962:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963832064 00000100:00100000:0.0:1788636442.447019:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 215 00000100:00100000:0.0:1788636442.447029:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+60:11634:x1875520963832064:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788636442.447058:0:5812:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788636442.447829:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+60:11634:x1875520963832064:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 798us (1751us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636442.447839:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 215 00000100:00100000:1.0:1788636442.469859:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.469973:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963832192 00000100:00100000:2.0:1788636442.469982:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963832192 00000100:00100000:2.0:1788636442.470039:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 216 00000100:00100000:2.0:1788636442.470053:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+60:11634:x1875520963832192:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788636442.470125:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470149:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470160:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470175:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470206:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470213:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470235:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470243:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470249:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636442.470286:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788636442.470291:0:7975:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636442.470304:0:7975:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470314:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470322:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470328:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470334:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636442.470338:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470353:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470366:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:2.0:1788636442.470369:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636442.470374:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470380:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa812f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470724:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470732:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470738:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470743:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636442.470746:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470752:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470761:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9cfd62575600) 00010000:00010000:2.0:1788636442.470764:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636442.470767:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470783:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8136 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470839:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470854:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470861:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470866:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636442.470869:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470875:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470883:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636442.470885:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636442.470888:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.470894:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa813d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636442.470961:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+60:11634:x1875520963832192:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 Request processed in 913us (1120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636442.470969:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 216 00000100:00100000:3.0:1788636442.479245:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.479413:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963832448 00000100:00100000:1.0:1788636442.479424:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963832448 00000100:00100000:1.0:1788636442.479494:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 217 00000100:00100000:1.0:1788636442.479506:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+60:11634:x1875520963832448:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636442.479536:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636442.479557:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa8144 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515588c expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479663:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479678:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479688:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636442.479700:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788636442.479836:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479874:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479881:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479887:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636442.479891:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479900:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479913:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:1.0:1788636442.479916:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788636442.479921:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479927:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa814b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479981:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa8144 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515588c expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.479991:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:1.0:1788636442.479993:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636442.479997:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa8144 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515588c expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.480006:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196bc00, rc 0) 00000100:00100000:1.0:1788636442.480064:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+61:11634:x1875520963832448:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 561us (830us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788636442.480070:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 217 00000100:00100000:1.0:1788636442.494673:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.495485:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963832576 00000100:00100000:2.0:1788636442.495496:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963832576 00000100:00100000:2.0:1788636442.495551:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 218 00000100:00100000:2.0:1788636442.495562:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd610e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+61:11634:x1875520963832576:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788636442.495604:0:7975:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788636442.495700:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd610e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+61:11634:x1875520963832576:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 140us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636442.495708:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 218 00000100:00100000:3.0:1788636442.500722:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.505787:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963832832 00000100:00100000:1.0:1788636442.505814:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963832832 00000100:00100000:0.0:1788636442.506107:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 219 00000100:00100000:0.0:1788636442.506119:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+61:11634:x1875520963832832:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636442.506269:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636442.506273:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788636442.506300:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb000/0xa6aa59fb12fa80e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155870 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.506322:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636442.506327:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636442.506340:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa8159 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155893 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788636442.507354:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:0.0:1788636442.509270:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa8160 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.509291:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa8160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.509302:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa8160 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.509365:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa8159 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155893 expref: 63 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.510058:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa8160 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155893 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.510082:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd500eba00) 00010000:00010000:0.0:1788636442.510094:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636442.510098:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191da00, rc 0) 00000100:00100000:0.0:1788636442.511059:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+62:11634:x1875520963832832:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 4857us (10260us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788636442.511070:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 219 00000100:00100000:0.0:1788636442.518712:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.518839:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963833088 00000100:00100000:2.0:1788636442.518858:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963833088 00000100:00100000:2.0:1788636442.518918:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 220 00000100:00100000:2.0:1788636442.518928:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+62:11634:x1875520963833088:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788636442.518998:0:7975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636442.519026:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191da00/0xa6aa59fb12fa8160 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155893 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519046:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd500eba00) 00010000:00010000:2.0:1788636442.519058:0:7975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636442.519078:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519092:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519101:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519116:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519137:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519145:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519206:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519213:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519220:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519226:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636442.519230:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519238:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519247:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:2.0:1788636442.519250:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636442.519253:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519260:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa816e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519270:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519284:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519289:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519294:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636442.519297:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519303:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519310:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x9a9ca9ea (ffff9cfd62575600) 00010000:00010000:2.0:1788636442.519312:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636442.519315:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.519321:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8175 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x9a9ca9ea bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636442.519695:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f927800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+61:11634:x1875520963833088:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 767us (991us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788636442.519704:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 220 00000100:00100000:1.0:1788636442.523341:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.525390:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963833216 00000100:00100000:2.0:1788636442.525410:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963833216 00000100:00100000:2.0:1788636442.525465:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 221 00000100:00100000:2.0:1788636442.525475:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+61:11634:x1875520963833216:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636442.525585:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636442.525622:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa817c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb98284483515589a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.525670:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.525684:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.525696:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.525785:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa817c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 63 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.525825:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 62 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.525834:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636442.525837:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636442.525841:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ebe00, rc 0) 00000100:00100000:2.0:1788636442.525913:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a283480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+62:11634:x1875520963833216:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 439us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636442.525920:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 221 00000100:00100000:3.0:1788636442.541018:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.546418:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963833472 00000100:00100000:0.0:1788636442.546439:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963833472 00000100:00100000:0.0:1788636442.546616:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 222 00000100:00100000:0.0:1788636442.546629:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+62:11634:x1875520963833472:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788636442.547269:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.547293:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.547307:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788636442.547627:0:5810:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:0.0:1788636442.547638:0:5810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311571841053ns, next at 312571838105ns, rc = 0 00000004:00010000:0.0:1788636442.547764:0:5810:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002efa260d reply state 0000000034c17c1b transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636442.547775:0:5810:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788636442.547934:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+64:11634:x1875520963833472:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 1305us (6982us total) trans 4294967505 rc 0/0 00000100:00100000:0.0:1788636442.552227:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 222 00000100:00100000:3.0:1788636442.552738:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00010000:00010000:1.0:1788636442.552808:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.552821:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.552829:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.552837:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191ca00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636442.552843:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.552862:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.552884:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:1.0:1788636442.552888:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788636442.552894:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.552901:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191ca00/0xa6aa59fb12fa818a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636442.563859:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963833600 00000100:00100000:2.0:1788636442.563883:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963833600 00000100:00100000:2.0:1788636442.564002:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 223 00000100:00100000:2.0:1788636442.564015:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+63:11634:x1875520963833600:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636442.564299:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636442.564345:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558a1 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.564424:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 64 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.564441:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 64 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.564464:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636442.564468:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636442.564472:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea600, rc 0) 00000100:00100000:2.0:1788636442.564592:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+64:11634:x1875520963833600:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 579us (11855us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636442.564599:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 223 00000100:00100000:1.0:1788636442.571538:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.573881:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963833728 00000100:00100000:2.0:1788636442.573902:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963833728 00000100:00100000:2.0:1788636442.574042:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:2.0:1788636442.574055:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963833728:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788636442.574453:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+10:2363:x1875520963833728:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 399us (2928us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1788636442.574462:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:3.0:1788636442.580139:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.580261:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963833984 00000100:00100000:0.0:1788636442.580275:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963833984 00000100:00100000:0.0:1788636442.580349:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 60 00000100:00100000:0.0:1788636442.580361:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+64:11634:x1875520963833984:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788636442.580679:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+65:11634:x1875520963833984:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 319us (552us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1788636442.580775:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 60 00000100:00100000:3.0:1788636442.585096:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.585246:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963834240 00000100:00100000:0.0:1788636442.585259:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963834240 00000100:00100000:0.0:1788636442.585942:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 224 00000100:00100000:0.0:1788636442.585959:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+65:11634:x1875520963834240:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788636442.586132:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+65:11634:x1875520963834240:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 178us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636442.586141:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 224 00000100:00100000:1.0:1788636442.591412:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636442.591520:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963834368 00000100:00100000:3.0:1788636442.591533:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963834368 00000100:00100000:3.0:1788636442.591599:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 225 00000100:00100000:3.0:1788636442.591611:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+65:11634:x1875520963834368:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636442.591636:0:5810:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636442.591662:0:5810:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa8198 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558a8 expref: -99 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.592041:0:5810:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa819f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.592070:0:5810:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.592086:0:5810:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636442.593320:0:5810:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636442.593366:0:5810:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa819f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.593414:0:5810:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc600/0xa6aa59fb12fa8198 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558a8 expref: 67 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.593439:0:5810:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa819f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558a8 expref: 66 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.594361:0:5810:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:3.0:1788636442.594368:0:5810:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788636442.594373:0:5810:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd820fd800, rc 0) 00000100:00100000:3.0:1788636442.594485:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+66:11634:x1875520963834368:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 2873us (3083us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636442.594495:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 225 00000100:00100000:3.0:1788636442.603036:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.603328:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963834496 00000100:00100000:1.0:1788636442.603341:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963834496 00000100:00100000:1.0:1788636442.603408:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00100000:1.0:1788636442.603418:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+10:2362:x1875520963834496:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636442.603439:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636442.603466:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558af expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788636442.603499:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6d1a, blocks: 0x1 00010000:00010000:1.0:1788636442.603521:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=311s v=(0 0) 00010000:00010000:1.0:1788636442.603527:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636442.603537:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 11 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.603557:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 11 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.603573:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196aa00, rc 0) 00000100:00100000:1.0:1788636442.603640:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+11:2362:x1875520963834496:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 224us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636442.603647:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00100000:3.0:1788636442.612777:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.613355:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963834752 00000100:00100000:2.0:1788636442.613369:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963834752 00000100:00100000:2.0:1788636442.613446:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 226 00000100:00100000:2.0:1788636442.613458:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+66:11634:x1875520963834752:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788636442.613603:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+66:11634:x1875520963834752:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 147us (841us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636442.613627:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 226 00000100:00100000:2.0:1788636442.628126:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.628833:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963834880 00000100:00100000:1.0:1788636442.628856:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963834880 00000100:00100000:1.0:1788636442.628931:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 65 00000100:00100000:1.0:1788636442.628943:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+11:11634:x1875520963834880:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636442.628995:0:6662:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636442.629020:0:6662:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558b6 expref: -99 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.629060:0:6662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 12 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.629071:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636442.629076:0:6662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636442.629083:0:6662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 12 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.629127:0:6662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 12 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.629145:0:6662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 12 pid: 6661 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636442.629320:0:6662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976401024:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636442.629506:0:6662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42c39480 going to sleep for 11 seconds 00000100:00100000:1.0:1788636442.638749:0:6662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6662:1875520976401024:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636442.638838:0:6662:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 12 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.638872:0:6662:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196b400, rc 0) 00000100:00100000:1.0:1788636442.638963:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:38630149-ece4-4de3-88b1-a62e16a39489+12:11634:x1875520963834880:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 10022us (10852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636442.638971:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 65 00000100:00100000:3.0:1788636442.645530:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.645659:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963835008 00000100:00100000:2.0:1788636442.645672:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963835008 00010000:00010000:2.0:1788636442.645741:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 12 pid: 6661 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636442.645837:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 81 00000100:00100000:2.0:1788636442.645859:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+12:2363:x1875520963835008:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636442.645887:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636442.645916:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 12 pid: 6661 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.645934:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 12 pid: 6661 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.646124:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa81a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558af expref: 12 pid: 6661 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.646146:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636442.646151:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636442.646171:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.646183:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.646252:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 11 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636442.646271:0:5797:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5797:1875520976401152:192.168.203.57@tcp:105: 00000100:00100000:2.0:1788636442.646380:0:5797:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc439ee540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636442.651398:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.651555:0:6666:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963835136 00000100:00100000:0.0:1788636442.651567:0:6666:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963835136 00002000:00100000:0.0:1788636442.651635:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9cfd6f5e9500 x1875520963835136/t0(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:683/0 lens 504/0 e 0 to 0 dl 1788636453 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636442.651646:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6f5e9500 with x1875520963835136 ext(0->12) 00002000:00010000:0.0:1788636442.651652:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd6f5e9500 00000100:00100000:0.0:1788636442.651702:0:6666:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:0.0:1788636442.651714:0:6666:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:38630149-ece4-4de3-88b1-a62e16a39489+12:2362:x1875520963835136:12345-192.168.203.57@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1788636442.652322:0:6666:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:38630149-ece4-4de3-88b1-a62e16a39489+14:2362:x1875520963835136:12345-192.168.203.57@tcp:4:lhsmtool_posix.0 Request processed in 608us (935us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1788636442.652338:0:6666:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00002000:00100000:0.0:1788636442.652346:0:6666:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9cfd6f5e9500 x1875520963835136/t4294967321(0) o4->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:683/0 lens 504/448 e 0 to 0 dl 1788636453 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788636442.652356:0:6666:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd6f5e9500 with x1875520963835136 ext(0->12) 00002000:00010000:0.0:1788636442.652360:0:6666:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd6f5e9500 00000100:00100000:3.0:1788636442.652870:0:5797:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5ebb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5797:1875520976401152:192.168.203.57@tcp:105: 00010000:00010000:3.0:1788636442.652901:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636442.652930:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:38630149-ece4-4de3-88b1-a62e16a39489+13:2363:x1875520963835008:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 7074us (7414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636442.652939:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 81 00000100:00100000:3.0:1788636442.655509:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.655619:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963835264 00000100:00100000:0.0:1788636442.655631:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963835264 00000100:00100000:0.0:1788636442.655706:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 227 00000100:00100000:0.0:1788636442.655718:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+66:11634:x1875520963835264:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788636442.785926:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:3.0:1788636442.785956:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788636442.785973:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788636442.785991:0:5832:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cfd5d1cd6c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788636442.785996:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd69b16200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd5d1cd180 00000020:00080000:3.0:1788636442.786000:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd69b16f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd818ed400 00000020:00080000:3.0:1788636442.786021:0:5832:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cfd48eb7300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788636442.786024:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd6999fc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd48eb7480 00000020:00080000:3.0:1788636442.786026:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd6999f600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd6f5f4000 00000004:00080000:3.0:1788636442.786082:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788636442.786263:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:3.0:1788636442.786427:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788636442.786438:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788636442.786456:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976401280:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788636442.786529:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636442.786597:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976401408:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788636442.786619:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636442.786640:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636442.786645:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976401536:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788636442.786665:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636442.786694:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976401280 00000100:00100000:3.0:1788636442.786701:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976401280 00000100:00100000:3.0:1788636442.786744:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976401408 00000100:00100000:3.0:1788636442.786747:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976401408 00000100:00100000:3.0:1788636442.786758:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976401536 00000100:00100000:3.0:1788636442.786759:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976401536 00000100:00100000:3.0:1788636442.786772:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788636442.786780:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976401280:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1788636442.786838:0:6963:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1788636442.786872:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.786893:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.786901:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1788636442.786906:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636442.786911:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.786936:0:6963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 12 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.786949:0:6963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 12 pid: 6659 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636442.786961:0:6963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6963:1875520976401664:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636442.787016:0:6963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd50bd7a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636442.787034:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788636442.787042:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1875520976401408:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1788636442.787154:0:6659:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788636442.787158:0:6659:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788636443 00002000:00010000:3.0:1788636442.787160:0:6659:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788636442.787162:0:6659:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788636442 -> 1788636443 00002000:00010000:3.0:1788636442.787171:0:6659:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788636442.787213:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3280:x1875520976401408:12345-0@lo:2:osp-syn-1-0.0 Request processed in 172us (593us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788636442.787221:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788636442.787238:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788636442.787244:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976401536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788636442.787256:0:6659:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1788636442.787275:0:6659:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9c6d19, atime: 0x6a9c6d19, ctime: 0x6a9c6d19, blocks: 0x1 00010000:00010000:3.0:1788636442.787281:0:6659:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.787289:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=311s v=(0 0) 00010000:00010000:3.0:1788636442.787292:0:6659:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636442.787298:0:6659:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.787311:0:6659:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.787320:0:6659:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.787327:0:6659:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.787342:0:6659:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788636442.787716:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3280:x1875520976401536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 471us (1048us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1788636442.787728:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:3.0:1788636442.787896:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd6f6ac000/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788636442.787903:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976401536:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1788636442.787914:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd6f6ac700/2, rc 0, transno 4294967322 00000100:00100000:3.0:1788636442.787918:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976401408:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788636442.787932:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788636442.788120:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636442.788128:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.788137:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636442.788142:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.788151:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.788168:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.788176:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000057e52519/0xa6aa59fb12fa81bb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6659 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.788212:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636442.788214:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636442.788216:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636442.788301:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+20:11634:x1875520963835264:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 Request processed in 132585us (132804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636442.788308:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 227 00000100:00100000:3.0:1788636442.796216:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636442.796286:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.796532:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963835392 00000100:00100000:2.0:1788636442.796541:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963835392 00000100:00100000:2.0:1788636442.796593:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:2.0:1788636442.796603:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+13:2363:x1875520963835392:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788636442.797028:0:6963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6963:1875520976401664:192.168.203.57@tcp:104: 00010000:00010000:0.0:1788636442.797055:0:6963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636442.797257:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963835520 00000100:00100000:1.0:1788636442.797262:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963835520 00010000:00010000:1.0:1788636442.797287:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 14 pid: 6659 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636442.797320:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 82 00000100:00100000:1.0:1788636442.797328:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+14:2363:x1875520963835520:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636442.797339:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636442.797345:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 14 pid: 6659 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.797358:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 14 pid: 6659 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.797379:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fff41394/0xa6aa59fb12fa7f76 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.57@tcp remote: 0xb982844835155815 expref: 14 pid: 6659 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.797396:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636442.797400:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788636442.797406:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.797417:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.797452:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636442.797517:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+13:2363:x1875520963835520:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 189us (1229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636442.797525:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 82 00010000:00010000:0.0:1788636442.799513:0:6963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.799530:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.799542:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.799550:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.799571:0:6963:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788636442.800072:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3282:x1875520976401280:12345-0@lo:6:osp-syn-1-0.0 Request processed in 13290us (13539us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788636442.800090:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:2.0:1788636442.800322:0:3282:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd6f6ace00/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788636442.800329:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976401280:0@lo:6:osp-syn-1-0.0 00010000:00010000:1.0:1788636442.803050:0:11147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636442.803067:0:11147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.803082:0:11147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997ca00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636442.803088:0:11147:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.803101:0:11147:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.803125:0:11147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.803133:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066c38d54/0xa6aa59fb12fa81b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.803161:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636442.803163:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636442.803165:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788636442.904384:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1788636442.904406:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:2.0:1788636442.904417:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:1.0:1788636442.904615:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963835392:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 Request processed in 108002us (108397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636442.904651:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:3.0:1788636442.918599:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636442.918661:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963835776 00000100:00100000:2.0:1788636442.918670:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963835776 00000100:00100000:2.0:1788636442.918724:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 228 00000100:00100000:2.0:1788636442.918733:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+20:11634:x1875520963835776:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788636442.918790:0:7975:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636442.918857:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fd800/0xa6aa59fb12fa819f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558a8 expref: 20 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.918877:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636442.918893:0:7975:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636442.918921:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.918934:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636442.918945:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636442.919163:0:7975:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000789cc497 reply state 000000004b4b5948 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636442.919172:0:7975:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636442.919268:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+21:11634:x1875520963835776:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 535us (679us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1788636442.919275:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 228 00010000:00010000:3.0:1788636442.927049:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.927067:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.927074:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.927080:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636442.927084:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.927100:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.927117:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:3.0:1788636442.927120:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636442.927125:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636442.927157:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636442.956129:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636442.956294:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963835904 00000100:00100000:1.0:1788636442.956312:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963835904 00000100:00100000:1.0:1788636442.956401:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 70 00000100:00100000:1.0:1788636442.956413:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963835904:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788636442.956698:0:6661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788636442.956702:0:6661:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788636443 -> 1788636442 00002000:00010000:1.0:1788636442.956705:0:6661:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788636441 00002000:00010000:1.0:1788636442.956708:0:6661:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788636443 -> 1788636442 00002000:00010000:1.0:1788636442.956710:0:6661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788636442.956856:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963835904:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 386us (677us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788636442.956864:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 70 00000100:00100000:3.0:1788636442.964291:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.966412:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963836160 00000100:00100000:0.0:1788636442.966425:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963836160 00000100:00100000:0.0:1788636442.966509:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 229 00000100:00100000:0.0:1788636442.966520:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+20:11634:x1875520963836160:12345-192.168.203.57@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788636442.966590:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.966607:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.966618:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.966652:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.966665:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 20 pid: 5812 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636442.966678:0:5811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f924380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976401792:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636442.966825:0:5811:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636442.971168:0:5811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f924380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5811:1875520976401792:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636442.971208:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636442.977886:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636442.977983:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963836288 00000100:00100000:0.0:1788636442.977994:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963836288 00010000:00010000:0.0:1788636442.978038:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 21 pid: 5812 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636442.978078:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 83 00000100:00100000:0.0:1788636442.978101:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+21:2362:x1875520963836288:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636442.978116:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636442.978123:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 21 pid: 5812 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.978136:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 21 pid: 5812 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.978160:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8183 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515589a expref: 21 pid: 5812 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.978282:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:0.0:1788636442.978289:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.978299:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.978307:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636442.978344:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636442.978412:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+20:2362:x1875520963836288:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 312us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636442.978419:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 83 00010000:00010000:1.0:1788636442.978582:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.978599:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.978644:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.978651:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.978659:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.978687:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636442.978693:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.978701:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.978720:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:1.0:1788636442.978722:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788636442.978728:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636442.978735:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa81c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636442.978902:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+19:11634:x1875520963836160:12345-192.168.203.57@tcp:55:lhsmtool_posix.0 Request processed in 12380us (14616us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788636442.978913:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 229 00000100:00100000:3.0:1788636443.009047:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636443.009148:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963836416 00000100:00100000:0.0:1788636443.009158:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963836416 00000100:00100000:0.0:1788636443.009214:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 71 00000100:00100000:0.0:1788636443.009224:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+8:2362:x1875520963836416:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788636443.009286:0:6963:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.009307:0:6963:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.009316:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788636443.009320:0:6963:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636443.009325:0:6963:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.009362:0:6963:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 8 pid: 6662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.009376:0:6963:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 8 pid: 6662 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636443.009390:0:6963:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f924a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6963:1875520976401920:192.168.203.57@tcp:104: 00000100:00100000:0.0:1788636443.009478:0:6963:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6125ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788636443.011190:0:6963:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f924a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6963:1875520976401920:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636443.011215:0:6963:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636443.012032:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636443.014440:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963836544 00000100:00100000:1.0:1788636443.014453:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963836544 00010000:00010000:0.0:1788636443.014652:0:5795:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 9 pid: 6662 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636443.014745:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:0.0:1788636443.014757:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+9:2363:x1875520963836544:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636443.014783:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636443.014855:0:5795:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 9 pid: 6662 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.014869:0:5795:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 9 pid: 6662 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.014893:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000227bf210/0xa6aa59fb12fa81ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb9828448351558b6 expref: 9 pid: 6662 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.014909:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636443.014913:0:5795:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636443.014919:0:5795:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.014929:0:5795:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636443.014968:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636443.015110:0:6963:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.015120:0:6963:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.015155:0:6963:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.015176:0:6963:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.015193:0:6963:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.015200:0:6963:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191dc00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636443.015205:0:6963:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.015215:0:6963:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.015226:0:6963:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.015234:0:6963:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa81d0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6963 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636443.015658:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2363:x1875520963836544:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 900us (3625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636443.015667:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:2.0:1788636443.016106:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+7:2362:x1875520963836416:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 Request processed in 6881us (7066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636443.016116:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 71 00000100:00100000:0.0:1788636443.021266:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636443.021401:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963836800 00000100:00100000:2.0:1788636443.021411:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963836800 00000100:00100000:2.0:1788636443.021476:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 230 00000100:00100000:2.0:1788636443.021502:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+19:11634:x1875520963836800:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788636443.021575:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.021592:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.021604:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.021884:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.021895:0:7975:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 20 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.021904:0:7975:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.021936:0:7975:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 20 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.021963:0:7975:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 20 pid: 7975 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636443.021978:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976402048:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636443.022057:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636443.025751:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976402048:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636443.025791:0:7975:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636443.035214:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636443.035301:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963836928 00000100:00100000:1.0:1788636443.035310:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963836928 00010000:00010000:1.0:1788636443.035350:0:6675:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 21 pid: 7975 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636443.035392:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 85 00000100:00100000:1.0:1788636443.035401:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+21:2360:x1875520963836928:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636443.035416:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636443.035435:0:6675:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 21 pid: 7975 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.035448:0:6675:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 21 pid: 7975 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.035481:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea600/0xa6aa59fb12fa8191 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351558a1 expref: 21 pid: 7975 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.035499:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:1.0:1788636443.035504:0:6675:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.035513:0:6675:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.035520:0:6675:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.035552:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636443.035604:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f926d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+20:2360:x1875520963836928:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 204us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636443.035611:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 85 00010000:00010000:2.0:1788636443.036653:0:7975:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.036665:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636443.036910:0:7975:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788636443.037073:0:7975:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1788636443.037119:0:7975:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1788636443.037641:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7975:1875520976402176:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788636443.037700:0:7975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636443.037736:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e13900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636443.037827:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976402176 00000100:00100000:0.0:1788636443.037833:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976402176 00000100:00100000:0.0:1788636443.037889:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788636443.037897:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7975:x1875520976402176:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788636443.038006:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5eb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7975:x1875520976402176:12345-0@lo:1000:mdt00_003.0 Request processed in 109us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636443.038013:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636443.038300:0:7975:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1788636443.038307:0:7975:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1788636443.038328:0:7975:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd6f6ac700, transno 4294967322 00000100:00100000:2.0:1788636443.038347:0:7975:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cfd6f6ace00 x1875520976401280/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788636458 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636443.038359:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7975:1875520976402176:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1788636443.042045:0:7975:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1788636443.042167:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7975:1875520976402304:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788636443.042240:0:7975:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636443.042275:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42e13900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636443.043759:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976402304 00000100:00100000:0.0:1788636443.043769:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976402304 00000100:00100000:0.0:1788636443.043864:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788636443.043874:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7975:x1875520976402304:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788636443.044120:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:7975:x1875520976402304:12345-0@lo:1000:mdt00_003.0 Request processed in 247us (1879us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1788636443.044128:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636443.044657:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5e9880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7975:1875520976402304:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1788636443.044700:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044711:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044731:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044737:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636443.044742:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044750:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044765:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd62575000) 00010000:00010000:2.0:1788636443.044768:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636443.044782:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044789:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81de lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044852:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044859:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044866:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044871:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636443.044874:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044891:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044899:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636443.044902:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636443.044909:0:7975:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155885 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044920:0:7975:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155885 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044930:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155885 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.044971:0:7975:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155885 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636443.044984:0:7975:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976402432:192.168.203.57@tcp:105: 00000100:00100000:2.0:1788636443.045048:0:7975:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d09e3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636443.066931:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636443.067061:0:7975:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5e9180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7975:1875520976402432:192.168.203.57@tcp:105: 00010000:00010000:2.0:1788636443.067091:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067102:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fc000/0xa6aa59fb12fa8121 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5810 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067140:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067168:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067343:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067356:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067363:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067379:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067385:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636443.067389:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067397:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067408:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636443.067411:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636443.067416:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067422:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa81e5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067434:0:7975:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067447:0:7975:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067453:0:7975:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067458:0:7975:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebe00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636443.067461:0:7975:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067585:0:7975:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067595:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636443.067598:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636443.067601:0:7975:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636443.067606:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa81d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636443.067867:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963837056 00000100:00100000:3.0:1788636443.067875:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963837056 00000100:00100000:3.0:1788636443.067919:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:3.0:1788636443.067928:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:11633:x1875520963837056:12345-192.168.203.57@tcp:49:lfs.0 00000100:00100000:3.0:1788636443.068111:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:11633:x1875520963837056:12345-192.168.203.57@tcp:49:lfs.0 Request processed in 183us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636443.068118:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 61 00000100:00100000:2.0:1788636443.068604:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f925180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+23:11634:x1875520963836800:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 47103us (47345us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1788636443.068614:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 230 00000020:00080000:2.0:1788636443.068618:0:7975:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788636443.069687:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636443.069693:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788636443.079890:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636443.079936:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000040:00080000:0.0:1788636443.079967:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788636443.079980:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788636443.080116:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963837440 00000100:00100000:2.0:1788636443.080125:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963837440 00000100:00100000:3.0:1788636443.080289:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 231 00000100:00100000:3.0:1788636443.080301:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+23:11633:x1875520963837440:12345-192.168.203.57@tcp:58:lfs.0 00000100:00100000:1.0:1788636443.080511:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963837568 00000100:00100000:1.0:1788636443.080515:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963837568 00000100:00100000:1.0:1788636443.080549:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 62 00000100:00100000:1.0:1788636443.080557:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd507d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+24:11634:x1875520963837568:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000040:00080000:3.0:1788636443.080656:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788636443.080741:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+25:11633:x1875520963837440:12345-192.168.203.57@tcp:58:lfs.0 Request processed in 442us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636443.080756:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 231 00000004:00080000:1.0:1788636443.081901:0:5814:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788636443.082016:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1788636443.082076:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.082093:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.082104:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.082111:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.082117:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.082123:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.082147:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788636443.082229:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd507d6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+25:11634:x1875520963837568:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 1669us (2288us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1788636443.082237:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 62 00000020:00080000:1.0:1788636443.082242:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788636443.082582:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636443.082589:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.082597:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636443.082601:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.082608:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.082621:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cfd5a43ce00) 00010000:00010000:3.0:1788636443.082623:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788636443.082628:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.082634:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a800/0xa6aa59fb12fa81ec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.082651:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636443.082653:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636443.082654:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636443.108777:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636443.108926:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963837696 00000100:00100000:1.0:1788636443.108936:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963837696 00000100:00100000:1.0:1788636443.108999:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 232 00000100:00100000:1.0:1788636443.109009:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+25:11636:x1875520963837696:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636443.109085:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636443.109107:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa81f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558bd expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109183:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109197:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109208:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109222:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109229:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109237:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109552:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109562:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109571:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109601:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.109626:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 26 pid: 5812 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636443.109640:0:5812:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976402560:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636443.109723:0:5812:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd43c836c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636443.112217:0:5812:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5812:1875520976402560:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636443.112244:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636443.113648:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636443.114165:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963837952 00000100:00100000:0.0:1788636443.114175:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963837952 00000100:00100000:0.0:1788636443.114234:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:0.0:1788636443.114244:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+27:5598:x1875520963837952:12345-192.168.203.57@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788636443.114992:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+28:5598:x1875520963837952:12345-192.168.203.57@tcp:35:ldlm_bl.0 Request processed in 747us (1346us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788636443.115000:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 63 00000100:00100000:2.0:1788636443.117223:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636443.117342:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963838080 00000100:00100000:3.0:1788636443.117360:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963838080 00010000:00010000:3.0:1788636443.117394:0:5796:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 28 pid: 5812 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636443.117450:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 86 00000100:00100000:3.0:1788636443.117460:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+28:2363:x1875520963838080:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636443.117474:0:5796:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636443.117481:0:5796:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 28 pid: 5812 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.117493:0:5796:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 28 pid: 5812 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.117515:0:5796:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd820fdc00/0xa6aa59fb12fa8113 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb98284483515587e expref: 28 pid: 5812 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.117530:0:5796:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636443.117536:0:5796:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.117545:0:5796:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.117553:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636443.117585:0:5796:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636443.117866:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:38630149-ece4-4de3-88b1-a62e16a39489+27:2363:x1875520963838080:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 406us (648us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636443.117873:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 86 00010000:00010000:1.0:1788636443.118138:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118147:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636443.118187:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788636443.118191:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636443.118210:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118223:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118233:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118239:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118259:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118265:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196bc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636443.118270:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118278:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118289:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:1.0:1788636443.118292:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636443.118296:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118303:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196bc00/0xa6aa59fb12fa81fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118315:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118321:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118327:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118332:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ac00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636443.118334:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118360:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118369:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cfd5a43c500) 00010000:00010000:1.0:1788636443.118372:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636443.118376:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118381:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ac00/0xa6aa59fb12fa8201 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118414:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b000/0xa6aa59fb12fa81f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558bd expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118428:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558bd expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636443.118435:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:1.0:1788636443.118437:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636443.118439:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ae00, rc 0) 00000100:00100000:1.0:1788636443.118467:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+26:11636:x1875520963837696:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 9461us (9700us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636443.118475:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 232 00010000:00010000:0.0:1788636443.264419:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788636443.888060:0:12603:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788636443.888076:0:12603:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788636443.888125:0:12603:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1788636443.888131:0:12603:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788636444.095063:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636444.095074:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636444.095112:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788636444.095119:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636444.095274:0:11663:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f926680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976402688:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636444.095399:0:11663:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c9600 going to sleep for 11 seconds 00000100:00100000:0.0:1788636444.104940:0:11663:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f926680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11663:1875520976402688:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788636444.106241:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636444.112996:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963838208 00000100:00100000:3.0:1788636444.113013:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963838208 00000100:00100000:3.0:1788636444.113112:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 233 00000100:00100000:3.0:1788636444.113123:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+26:11649:x1875520963838208:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788636444.113157:0:5811:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00080000:1.0:1788636444.113165:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636444.113275:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+26:11649:x1875520963838208:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 154us (7038us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636444.113282:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 233 00000100:00100000:2.0:1788636444.125977:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636444.126448:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963838464 00000100:00100000:3.0:1788636444.126458:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963838464 00000100:00100000:3.0:1788636444.126521:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 234 00000100:00100000:3.0:1788636444.126532:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+26:11649:x1875520963838464:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636444.126552:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636444.126584:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa820f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558c4 expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636444.126679:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa8216 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636444.126706:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa8216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636444.126719:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa8216 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636444.126731:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788636444.133938:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d000/0xa6aa59fb12fa820f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558c4 expref: 29 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.135371:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa8216 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558c4 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.135384:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636444.135388:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788636444.135392:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c200, rc 0) 00000100:00100000:2.0:1788636444.136415:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7590d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+28:11649:x1875520963838464:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 9878us (10440us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1788636444.136426:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 234 00000100:00100000:0.0:1788636444.159973:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636444.160607:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963838592 00000100:00100000:1.0:1788636444.160617:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963838592 00000100:00100000:1.0:1788636444.160689:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:1.0:1788636444.160700:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+28:2362:x1875520963838592:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636444.160728:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636444.160754:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c200/0xa6aa59fb12fa8216 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558c4 expref: 28 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636444.160774:0:6675:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:1.0:1788636444.160780:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636444.162704:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69ac7450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:38630149-ece4-4de3-88b1-a62e16a39489+27:2362:x1875520963838592:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 1997us (2743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636444.162717:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:0.0:1788636444.163455:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636444.163601:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963838848 00000100:00100000:3.0:1788636444.163610:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963838848 00000100:00100000:3.0:1788636444.163736:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 235 00000100:00100000:3.0:1788636444.163746:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+27:11649:x1875520963838848:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788636444.164130:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164371:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164385:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164557:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164565:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164571:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164576:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebc00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636444.164592:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164599:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164610:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636444.164613:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788636444.164618:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636444.164625:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa8224 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636444.164895:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f926680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+28:11649:x1875520963838848:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 1149us (1441us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788636444.164904:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 235 00000040:00080000:0.0:1788636444.167214:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636444.167222:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636444.167941:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788636444.167950:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788636444.174906:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636444.174993:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963839104 00000100:00100000:1.0:1788636444.175002:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963839104 00000100:00100000:1.0:1788636444.175060:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 64 00000100:00100000:1.0:1788636444.175070:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+28:11649:x1875520963839104:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788636444.175317:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f926300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+29:11649:x1875520963839104:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 248us (420us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788636444.175325:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 64 00010000:00010000:1.0:1788636444.290209:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636444.293548:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976403072:0@lo:400:kworker.0 00000100:00100000:3.0:1788636444.293561:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976402816:0@lo:400:kworker.0 00000100:00100000:1.0:1788636444.293625:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976402944:0@lo:400:kworker.0 00000100:00100000:2.0:1788636444.295626:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7590df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976403200:0@lo:400:kworker.0 00000100:00100000:3.0:1788636444.296541:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636444.296596:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976403328:0@lo:400:kworker.0 00000100:00100000:3.0:1788636444.296626:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636444.296679:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976402816 00000100:00100000:3.0:1788636444.296685:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976402816 00000100:00100000:3.0:1788636444.296723:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788636444.296732:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976402816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636444.296865:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976402816:12345-0@lo:400:kworker.0 Request processed in 134us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636444.296873:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1788636444.296914:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976402816:0@lo:400:kworker.0 00000100:00100000:3.0:1788636444.296955:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976403328 00000100:00100000:3.0:1788636444.296959:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976403328 00000100:00100000:1.0:1788636444.297024:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636444.297048:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd818df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976403456:0@lo:400:kworker.0 00000100:00100000:1.0:1788636444.297072:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788636444.297099:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636444.297110:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976403456 00000100:00100000:1.0:1788636444.297113:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976403456 00000100:00100000:1.0:1788636444.297144:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788636444.297151:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1875520976403456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636444.297200:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1875520976403456:12345-0@lo:400:kworker.0 Request processed in 50us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636444.297206:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1788636444.297222:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636444.297232:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976402944 00000100:00100000:1.0:1788636444.297235:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976402944 00000100:00100000:1.0:1788636444.297258:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788636444.297264:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976402944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636444.297295:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976402944:12345-0@lo:400:kworker.0 Request processed in 31us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636444.297301:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788636444.297375:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788636444.297383:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875520976403328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636444.297419:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875520976403328:12345-0@lo:400:kworker.0 Request processed in 37us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636444.303883:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976402944:0@lo:400:kworker.0 00000100:00100000:1.0:1788636444.303903:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976403456:0@lo:400:kworker.0 00000100:00100000:0.0:1788636444.304066:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636444.304268:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976403072 00000100:00100000:1.0:1788636444.304275:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976403072 00000100:00100000:1.0:1788636444.304337:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788636444.304345:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976403072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636444.304401:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f925f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976403072:12345-0@lo:400:kworker.0 Request processed in 57us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636444.304408:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788636444.305442:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636444.305538:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd818dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976403328:0@lo:400:kworker.0 00000100:00100000:1.0:1788636444.305623:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976403200 00000100:00100000:1.0:1788636444.305629:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976403200 00000100:00100000:1.0:1788636444.305674:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788636444.305682:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3281:x1875520976403200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636444.305732:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3281:x1875520976403200:12345-0@lo:400:kworker.0 Request processed in 51us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636444.305754:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788636444.305784:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976403200:0@lo:400:kworker.0 00000100:00080000:0.0:1788636444.305876:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636444.305881:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636444.305903:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7590f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976403072:0@lo:400:kworker.0 00000100:00100000:3.0:1788636444.307654:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788636444.801322:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636444.801346:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976403584:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636444.801415:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636444.807103:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976403584 00000100:00100000:3.0:1788636444.807118:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976403584 00000100:00100000:3.0:1788636444.807401:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788636444.807423:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875520976403584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636444.807461:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636444.807668:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ca6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3281:x1875520976403584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 247us (6251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636444.807676:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788636444.808063:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f924e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976403584:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788636444.874520:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1788636444.874534:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:2.0:1788636444.874543:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1788636445.311988:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788636445.965555:0:12655:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788636445.965567:0:12655:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636445.965615:0:12655:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788636445.965622:0:12655:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788636446.083884:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636446.090695:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963839360 00000100:00100000:3.0:1788636446.090882:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963839360 00000100:00080000:0.0:1788636446.090964:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636446.091018:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 236 00000100:00100000:3.0:1788636446.091036:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+29:11669:x1875520963839360:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636446.091067:0:7975:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636446.091099:0:7975:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa822b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558cb expref: -99 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636446.091251:0:7975:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa8232 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636446.091268:0:7975:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa8232 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636446.091285:0:7975:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa8232 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7975 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636446.091299:0:7975:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788636446.091471:0:7975:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997ca00/0xa6aa59fb12fa822b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558cb expref: 32 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636446.091490:0:7975:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa8232 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558cb expref: 31 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636446.091517:0:7975:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:3.0:1788636446.091519:0:7975:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788636446.091523:0:7975:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997d600, rc 0) 00000100:00100000:3.0:1788636446.091683:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+31:11669:x1875520963839360:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 654us (7812us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788636446.091693:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 236 00000100:00100000:3.0:1788636446.094571:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636446.094747:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963839488 00000100:00100000:2.0:1788636446.094760:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963839488 00000100:00100000:2.0:1788636446.094875:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 237 00000100:00100000:2.0:1788636446.094886:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+31:11669:x1875520963839488:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:2.0:1788636446.095170:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095204:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095218:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095251:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095258:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095265:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095271:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636446.095276:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095284:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095299:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:2.0:1788636446.095302:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636446.095308:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636446.095314:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea800/0xa6aa59fb12fa8240 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636446.095403:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:38630149-ece4-4de3-88b1-a62e16a39489+31:11669:x1875520963839488:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 519us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636446.095416:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 237 00000100:00100000:0.0:1788636446.162154:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636446.162216:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963839616 00000100:00100000:0.0:1788636446.162228:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963839616 00000100:00100000:0.0:1788636446.162295:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 72 00000100:00100000:0.0:1788636446.162306:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963839616:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:0.0:1788636446.162328:0:6661:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636446.162354:0:6661:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa8247 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558d2 expref: -99 pid: 6661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788636446.162403:0:6661:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9c6d1a, atime: 0x6a9c6d19, ctime: 0x6a9c6d1a, blocks: 0xb 00010000:00010000:0.0:1788636446.162425:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1788636446.162431:0:6661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636446.162442:0:6661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa8247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558d2 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636446.162464:0:6661:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa8247 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558d2 expref: 8 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636446.162481:0:6661:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191dc00, rc 0) 00000100:00100000:0.0:1788636446.162548:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f924700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+8:2361:x1875520963839616:12345-192.168.203.57@tcp:101:cat.0 Request processed in 245us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636446.162555:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 72 00000100:00080000:0.0:1788636446.162578:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636446.168787:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636446.169774:0:6665:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963839744 00000100:00100000:3.0:1788636446.169789:0:6665:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963839744 00002000:00100000:3.0:1788636446.170050:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9cfd818dca80 x1875520963839744/t0(0) o3->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:687/0 lens 488/0 e 0 to 0 dl 1788636457 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788636446.170063:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd818dca80 with x1875520963839744 ext(0->4095) 00002000:00010000:3.0:1788636446.170070:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd818dca80 00000100:00100000:3.0:1788636446.170123:0:6665:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:3.0:1788636446.170135:0:6665:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2360:x1875520963839744:12345-192.168.203.57@tcp:3:cat.0 00000100:00100000:3.0:1788636446.170426:0:6665:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2360:x1875520963839744:12345-192.168.203.57@tcp:3:cat.0 Request processed in 292us (1654us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788636446.170435:0:6665:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00002000:00100000:3.0:1788636446.170442:0:6665:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9cfd818dca80 x1875520963839744/t0(0) o3->38630149-ece4-4de3-88b1-a62e16a39489@192.168.203.57@tcp:687/0 lens 488/4536 e 0 to 0 dl 1788636457 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788636446.170450:0:6665:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cfd818dca80 with x1875520963839744 ext(0->4095) 00002000:00010000:3.0:1788636446.170454:0:6665:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9cfd818dca80 00000040:00080000:2.0:1788636446.207381:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788636446.207395:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636446.207433:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788636446.207441:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788636446.335407:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636446.335700:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636446.335731:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976403712:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636446.335854:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636446.336080:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976403712 00000100:00100000:3.0:1788636446.336106:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976403712 00000100:00100000:3.0:1788636446.336195:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788636446.336206:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976403712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636446.336254:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636446.336321:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976403712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636446.336328:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788636446.336469:0:3280:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788636446.336477:0:3280:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788636446.336507:0:3280:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd6f6ac000, transno 4294967310 00000100:00100000:1.0:1788636446.336531:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f924000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976403712:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788636446.336685:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636447.312170:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636447.312218:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636447.312246:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636447.312266:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636447.312291:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636447.312325:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963840128 00000100:00100000:0.0:1788636447.312336:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963840128 00000100:00100000:0.0:1788636447.312404:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963840256 00000100:00100000:3.0:1788636447.312406:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963839872 00000100:00100000:0.0:1788636447.312407:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963840256 00000100:00100000:0.0:1788636447.312432:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 96 00000100:00100000:0.0:1788636447.312462:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963840128:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636447.312550:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f924000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963840128:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 92us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636447.312567:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 96 00000100:00100000:0.0:1788636447.312582:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 97 00000100:00100000:0.0:1788636447.312587:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2363:x1875520963840256:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636447.312789:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f925500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:38630149-ece4-4de3-88b1-a62e16a39489+8:2363:x1875520963840256:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 23us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636447.312845:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 97 00000100:00100000:0.0:1788636447.312867:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963840384 00000100:00100000:0.0:1788636447.312872:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963840384 00000100:00100000:0.0:1788636447.312902:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963840000 00000100:00100000:0.0:1788636447.312905:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963840000 00000100:00100000:0.0:1788636447.312928:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 153 00000100:00100000:0.0:1788636447.312935:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2363:x1875520963840384:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636447.312958:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f924e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2363:x1875520963840384:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 26us (712us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636447.312963:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 153 00000100:00100000:0.0:1788636447.312971:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 154 00000100:00100000:0.0:1788636447.312974:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+31:2363:x1875520963840000:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636447.312990:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f926d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:38630149-ece4-4de3-88b1-a62e16a39489+31:2363:x1875520963840000:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 16us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636447.312994:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 154 00000100:00080000:0.0:1788636447.313008:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788636447.313017:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636447.313111:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963839872 00000100:00100000:3.0:1788636447.313225:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 295 00000100:00100000:3.0:1788636447.313234:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963839872:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636447.313264:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963839872:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 32us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636447.313270:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 295 00010000:00010000:1.0:1788636447.362075:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788636447.912859:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788636447.912875:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788636447.917152:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967515 is committed 00000001:00080000:1.0:1788636447.917164:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1788636447.917182:0:5832:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cfd457ded80 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788636447.917187:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd45a00000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cfd457deb40 00000020:00080000:1.0:1788636447.917191:0:5832:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cfd45a00400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cfc439d5c00 00000001:00080000:1.0:1788636447.917222:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1788636447.917230:0:5832:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1788636447.917296:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788636447.917508:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:0.0:1788636448.385751:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636449.409354:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636449.417119:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976404096:0@lo:400:kworker.0 00000100:00100000:3.0:1788636449.417191:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636449.417255:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636449.417261:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976404224:0@lo:400:kworker.0 00000100:00100000:3.0:1788636449.417284:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636449.417320:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976404096 00000100:00100000:3.0:1788636449.417327:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976404096 00000100:00100000:3.0:1788636449.417377:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788636449.417386:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976404096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636449.417438:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976404096:12345-0@lo:400:kworker.0 Request processed in 53us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636449.417455:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788636449.417481:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976404224 00000100:00100000:3.0:1788636449.417485:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976404224 00000100:00100000:3.0:1788636449.417513:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788636449.417520:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976404224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636449.417550:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75973800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976404224:12345-0@lo:400:kworker.0 Request processed in 31us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636449.417556:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788636449.417575:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636449.417579:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636449.417624:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976404224:0@lo:400:kworker.0 00000100:00100000:3.0:1788636449.417636:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976404096:0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.417726:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd75b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976403840:0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.417771:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636449.417828:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976404352:0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.417851:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636449.417871:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788636449.417876:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976403968:0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.417897:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636449.417915:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976404480:0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.417945:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636449.417971:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976404352 00000100:00100000:0.0:1788636449.417975:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976404352 00000100:00100000:0.0:1788636449.418013:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976403968 00000100:00100000:0.0:1788636449.418017:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976403968 00000100:00100000:0.0:1788636449.418033:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788636449.418039:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875520976404352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.418071:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f925c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3282:x1875520976404352:12345-0@lo:400:kworker.0 Request processed in 32us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636449.418076:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788636449.418087:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788636449.418092:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976403968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.418113:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f926a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976403968:12345-0@lo:400:kworker.0 Request processed in 21us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636449.418118:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788636449.418135:0:6662:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976404480 00000100:00100000:0.0:1788636449.418145:0:6662:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976404480 00000100:00100000:0.0:1788636449.418171:0:6662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788636449.418178:0:6662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976404480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.418208:0:6662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f924a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976404480:12345-0@lo:400:kworker.0 Request processed in 31us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636449.418213:0:6662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788636449.418243:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976403968:0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.418251:0:3282:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788636449.418255:0:3282:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd6f6ace00, transno 4294967323 00000004:00080000:0.0:1788636449.418265:0:3282:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788636449.418281:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976404480:0@lo:400:kworker.0 00000100:00100000:0.0:1788636449.418291:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976404352:0@lo:400:kworker.0 00000100:00100000:3.0:1788636449.421056:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976403840 00000100:00100000:3.0:1788636449.421070:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976403840 00000100:00100000:3.0:1788636449.421121:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1788636449.421131:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976403840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636449.421212:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976403840:12345-0@lo:400:kworker.0 Request processed in 83us (3440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636449.421220:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:3.0:1788636449.421250:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636449.421257:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636449.421283:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd75b9b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976403840:0@lo:400:kworker.0 00000100:00100000:2.0:1788636449.919978:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976404608:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636449.920102:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636449.920217:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976404608 00000100:00100000:0.0:1788636449.920225:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976404608 00000100:00100000:0.0:1788636449.920278:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788636449.920287:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976404608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636449.920319:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636449.920368:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976404608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636449.920375:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788636449.921333:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976404608:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788636450.442032:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636451.455099:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7fe3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976404736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636451.455169:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636451.455352:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976404736 00000100:00100000:1.0:1788636451.455360:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976404736 00000100:00100000:1.0:1788636451.455424:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788636451.455434:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976404736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636451.455476:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636451.455524:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976404736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636451.455531:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788636451.455586:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7fe3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976404736:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788636451.455651:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788636451.457060:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636452.019377:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636452.020743:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963840512 00000100:00100000:0.0:1788636452.020754:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963840512 00000100:00100000:0.0:1788636452.020966:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 238 00000100:00100000:0.0:1788636452.020977:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+18:11313:x1875520963840512:12345-192.168.203.57@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788636452.021272:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+18:11313:x1875520963840512:12345-192.168.203.57@tcp:60:lhsmtool_posix.0 Request processed in 296us (1915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636452.021281:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 238 00000100:00080000:3.0:1788636452.021714:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636452.026187:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636452.026514:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963840768 00000100:00100000:0.0:1788636452.026523:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963840768 00000100:00100000:0.0:1788636452.026582:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 65 00000100:00100000:0.0:1788636452.026592:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+18:11313:x1875520963840768:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788636452.027624:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:11313:x1875520963840768:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 1030us (1443us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788636452.027633:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 65 00000100:00100000:3.0:1788636452.429078:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636452.429143:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636452.429189:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636452.429227:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636452.429420:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963840896 00000100:00100000:3.0:1788636452.429434:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963840896 00000100:00100000:3.0:1788636452.429497:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 297 00000100:00100000:3.0:1788636452.429572:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963840896:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636452.429694:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963841024 00000100:00100000:1.0:1788636452.429710:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963841024 00000100:00100000:3.0:1788636452.429731:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:003dba47-3849-46de-b5b5-7b33358ec353+13:2363:x1875520963840896:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 221us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636452.429740:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 297 00000100:00100000:1.0:1788636452.429856:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963841152 00000100:00100000:1.0:1788636452.429862:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963841152 00000100:00100000:1.0:1788636452.429894:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 100 00000100:00100000:1.0:1788636452.429904:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963841024:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636452.430089:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75971c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2363:x1875520963841024:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 186us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636452.430097:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 100 00000100:00100000:1.0:1788636452.430279:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 101 00000100:00100000:1.0:1788636452.430290:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963841152:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636452.430358:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963841280 00000100:00100000:2.0:1788636452.430363:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963841280 00000100:00100000:2.0:1788636452.430396:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 158 00000100:00100000:2.0:1788636452.430403:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2363:x1875520963841280:12345-192.168.203.57@tcp:400:kworker.0 00000100:00080000:3.0:1788636452.432098:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636452.432109:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636452.432112:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636452.449201:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b9b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2363:x1875520963841152:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 18898us (19958us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636452.449230:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 101 00000100:00100000:2.0:1788636452.450752:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+5:2363:x1875520963841280:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 20339us (21597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636452.450770:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 158 00010000:00010000:0.0:1788636452.479067:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636452.568858:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636452.569019:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963841408 00000100:00100000:2.0:1788636452.569033:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963841408 00000100:00100000:2.0:1788636452.569110:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 239 00000100:00100000:2.0:1788636452.569124:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+5:12121:x1875520963841408:12345-192.168.203.57@tcp:101:lsof.0 00010000:00010000:2.0:1788636452.569149:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636452.569194:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa824e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351558d9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636452.569294:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8255 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636452.569314:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636452.569328:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636452.569371:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788636452.569376:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636452.569402:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8255 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636452.569431:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa824e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558d9 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636452.569452:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8255 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558d9 expref: 6 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636452.569462:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:2.0:1788636452.569465:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636452.569470:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb800, rc 0) 00000100:00100000:2.0:1788636452.573208:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+6:12121:x1875520963841408:12345-192.168.203.57@tcp:101:lsof.0 Request processed in 4067us (4344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636452.573225:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 239 00000001:00080000:1.0:1788636453.172667:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788636453.172697:0:5832:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:3.0:1788636453.172830:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:3.0:1788636453.172846:0:5843:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788636453.507913:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636454.527681:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976405248:0@lo:400:kworker.0 00000100:00100000:0.0:1788636454.527789:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636454.527894:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636454.527901:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976405120:0@lo:400:kworker.0 00000100:00100000:0.0:1788636454.527934:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636454.527974:0:6659:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976405248 00000100:00100000:0.0:1788636454.527983:0:6659:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976405248 00000100:00100000:0.0:1788636454.528051:0:6659:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788636454.528062:0:6659:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976405248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636454.528246:0:6659:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976405248:12345-0@lo:400:kworker.0 Request processed in 186us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636454.528255:0:6659:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788636454.528352:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976404992:0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.528401:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636454.528421:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976405504:0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.528442:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636454.528461:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788636454.528467:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976404864:0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.528496:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636454.528519:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976405376:0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.528539:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636454.528571:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976405120 00000100:00100000:2.0:1788636454.528575:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976405120 00000100:00100000:2.0:1788636454.528605:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976404992 00000100:00100000:2.0:1788636454.528608:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976404992 00000100:00100000:2.0:1788636454.528621:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976405376 00000100:00100000:2.0:1788636454.528623:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976405376 00000100:00100000:2.0:1788636454.528637:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788636454.528643:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875520976405120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.528679:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875520976405120:12345-0@lo:400:kworker.0 Request processed in 36us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636454.528686:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788636454.528704:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788636454.528709:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976404992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.528738:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976404992:12345-0@lo:400:kworker.0 Request processed in 29us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636454.528744:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788636454.528753:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788636454.528758:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976405376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.528835:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976405376:12345-0@lo:400:kworker.0 Request processed in 77us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636454.528841:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788636454.528860:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976405504 00000100:00100000:2.0:1788636454.528864:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976405504 00000100:00100000:2.0:1788636454.528891:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788636454.528898:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976405504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.528928:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976405504:12345-0@lo:400:kworker.0 Request processed in 31us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636454.528934:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788636454.528952:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976404864 00000100:00100000:2.0:1788636454.528955:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976404864 00000100:00100000:2.0:1788636454.528977:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788636454.528982:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976404864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.529008:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976404864:12345-0@lo:400:kworker.0 Request processed in 25us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636454.529013:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1788636454.529063:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f924380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976404864:0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.529077:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976405376:0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.529084:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f927100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976404992:0@lo:400:kworker.0 00000100:00100000:2.0:1788636454.529092:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976405504:0@lo:400:kworker.0 00000100:00100000:0.0:1788636454.529251:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976405120:0@lo:400:kworker.0 00000100:00100000:0.0:1788636454.529442:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976405248:0@lo:400:kworker.0 00010000:00010000:1.0:1788636454.529624:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636454.530568:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636454.530577:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788636454.530581:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636455.039080:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788636455.039110:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976405632:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636455.039204:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636455.039306:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976405632 00000100:00100000:0.0:1788636455.039317:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976405632 00000100:00100000:0.0:1788636455.039390:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788636455.039400:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976405632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636455.039449:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636455.039512:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976405632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636455.039520:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788636455.039607:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976405632:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636455.558189:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788636456.447396:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636456.447416:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636456.448189:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788636456.448200:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788636456.580247:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636456.580540:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976405760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636456.580642:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636456.581084:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976405760 00000100:00100000:1.0:1788636456.581096:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976405760 00000100:00100000:1.0:1788636456.581175:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788636456.581186:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976405760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636456.581236:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788636456.581729:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636456.582281:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976405760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1093us (1635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636456.582292:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788636456.582728:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976405760:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788636457.357329:0:12860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 15:27:35 (1788636455) 00000100:00100000:3.0:1788636457.544675:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636457.544734:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636457.544770:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963841536 00000100:00100000:0.0:1788636457.544783:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963841536 00000100:00100000:3.0:1788636457.544827:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636457.544874:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636457.544911:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636457.544942:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963842048 00000100:00100000:3.0:1788636457.544946:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963842048 00000100:00100000:0.0:1788636457.544958:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 299 00000100:00100000:0.0:1788636457.544972:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963841536:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636457.544996:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963841664 00000100:00100000:3.0:1788636457.545001:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963841664 00000100:00100000:3.0:1788636457.545033:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 162 00000100:00100000:3.0:1788636457.545043:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2361:x1875520963842048:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636457.545069:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+13:2361:x1875520963841536:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 99us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636457.545078:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 299 00000100:00100000:3.0:1788636457.545095:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2361:x1875520963842048:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 43us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636457.545103:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 162 00000100:00100000:3.0:1788636457.545121:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 163 00000100:00100000:3.0:1788636457.545128:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+18:2361:x1875520963841664:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636457.545184:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a280e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:38630149-ece4-4de3-88b1-a62e16a39489+18:2361:x1875520963841664:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 43us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636457.545192:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 163 00000100:00100000:3.0:1788636457.545224:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963841792 00000100:00100000:3.0:1788636457.545228:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963841792 00000100:00100000:3.0:1788636457.545263:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963841920 00000100:00100000:3.0:1788636457.545266:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963841920 00000100:00100000:3.0:1788636457.545300:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 104 00000100:00100000:3.0:1788636457.545308:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963841792:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636457.545348:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75ba0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2361:x1875520963841792:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 41us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636457.545355:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 104 00000100:00100000:3.0:1788636457.545384:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 105 00000100:00100000:3.0:1788636457.545393:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963841920:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636457.545423:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a282300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2361:x1875520963841920:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 32us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636457.545428:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 105 00000100:00080000:3.0:1788636457.545446:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788636457.545450:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636457.545453:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788636457.608426:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636458.631648:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636459.658098:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636459.658401:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976406144:0@lo:400:kworker.0 00000100:00100000:2.0:1788636459.658465:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636459.658537:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636459.658554:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976406272:0@lo:400:kworker.0 00000100:00100000:2.0:1788636459.658579:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636459.658612:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976406144 00000100:00100000:2.0:1788636459.658618:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976406144 00000100:00100000:2.0:1788636459.658670:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788636459.658680:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976406144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636459.658736:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976406144:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636459.658743:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:2.0:1788636459.658763:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636459.658793:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976406144:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.658931:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976406016:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.658961:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636459.658988:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976406528:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659019:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636459.659044:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788636459.659050:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976405888:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659076:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636459.659098:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976406400:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659118:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636459.659143:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976406272 00000100:00100000:1.0:1788636459.659147:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976406272 00000100:00100000:1.0:1788636459.659179:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976406528 00000100:00100000:1.0:1788636459.659182:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976406528 00000100:00100000:1.0:1788636459.659218:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788636459.659225:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976406272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659272:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976406272:12345-0@lo:400:kworker.0 Request processed in 48us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636459.659278:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788636459.659291:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788636459.659297:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976406528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659327:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976406528:12345-0@lo:400:kworker.0 Request processed in 30us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636459.659332:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788636459.659349:0:5804:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976405888 00000100:00100000:1.0:1788636459.659352:0:5804:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976405888 00000100:00100000:1.0:1788636459.659373:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788636459.659393:0:5804:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976405888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659420:0:5804:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69978050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976405888:12345-0@lo:400:kworker.0 Request processed in 29us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636459.659425:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:1.0:1788636459.659450:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976406016 00000100:00100000:1.0:1788636459.659453:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976406016 00000100:00100000:1.0:1788636459.659473:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976406400 00000100:00100000:1.0:1788636459.659476:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976406400 00000100:00100000:1.0:1788636459.659493:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788636459.659498:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976406016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659525:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976406016:12345-0@lo:400:kworker.0 Request processed in 26us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636459.659529:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788636459.659550:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788636459.659556:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976406400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659592:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976406400:12345-0@lo:400:kworker.0 Request processed in 36us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636459.659598:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00080000:1.0:1788636459.659612:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788636459.659615:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636459.659618:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636459.659641:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976406272:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659665:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976405888:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659674:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976406400:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659682:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976406016:0@lo:400:kworker.0 00000100:00100000:1.0:1788636459.659690:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976406528:0@lo:400:kworker.0 00000100:00100000:3.0:1788636460.159555:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636460.159578:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976406656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636460.159647:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636460.159853:0:6664:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976406656 00000100:00100000:0.0:1788636460.159862:0:6664:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976406656 00000100:00100000:0.0:1788636460.159929:0:6664:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636460.159939:0:6664:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976406656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636460.160001:0:6664:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636460.160300:0:6664:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976406656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 363us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636460.160308:0:6664:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788636460.160390:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976406656:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788636460.671210:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636461.698655:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636461.698931:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976406784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636461.699014:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636461.701690:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976406784 00000100:00100000:3.0:1788636461.701702:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976406784 00000100:00100000:3.0:1788636461.702069:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788636461.702087:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976406784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636461.702130:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788636461.702457:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636461.702868:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976406784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 782us (3852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636461.702876:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788636461.709913:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976406784:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636462.611779:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636462.612461:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963842304 00000100:00100000:0.0:1788636462.612471:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963842304 00000100:00100000:0.0:1788636462.612577:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 66 00000100:00100000:0.0:1788636462.612589:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+18:12343:x1875520963842304:12345-192.168.203.57@tcp:35:umount.0 00000100:00080000:1.0:1788636462.615779:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636462.616305:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:12343:x1875520963842304:12345-192.168.203.57@tcp:35:umount.0 Request processed in 3712us (4536us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1788636462.616317:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 66 00000100:00100000:3.0:1788636462.625042:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636462.627448:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963842560 00000100:00100000:0.0:1788636462.627461:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963842560 00000100:00100000:0.0:1788636462.627532:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 67 00000100:00100000:0.0:1788636462.627542:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+19:12343:x1875520963842560:12345-192.168.203.57@tcp:35:umount.0 00000100:00100000:0.0:1788636462.627961:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+20:12343:x1875520963842560:12345-192.168.203.57@tcp:35:umount.0 Request processed in 420us (2927us total) trans 4294967522 rc 0/0 00000100:00100000:0.0:1788636462.627976:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 67 00000100:00100000:1.0:1788636462.632187:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636462.632615:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963842816 00000100:00100000:0.0:1788636462.632634:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963842816 00000100:00100000:0.0:1788636462.632687:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 68 00000100:00100000:0.0:1788636462.632696:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd507d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+20:12343:x1875520963842816:12345-192.168.203.57@tcp:35:umount.0 00000100:00100000:0.0:1788636462.633234:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd507d6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:38630149-ece4-4de3-88b1-a62e16a39489+21:12343:x1875520963842816:12345-192.168.203.57@tcp:35:umount.0 Request processed in 537us (1053us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1788636462.633241:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 68 00000100:00100000:1.0:1788636462.646116:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636462.646665:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963843072 00000100:00100000:3.0:1788636462.646675:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963843072 00000100:00100000:3.0:1788636462.646740:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:3.0:1788636462.646749:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+21:12343:x1875520963843072:12345-192.168.203.57@tcp:35:umount.0 00000100:00100000:3.0:1788636462.647112:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41aa3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:38630149-ece4-4de3-88b1-a62e16a39489+22:12343:x1875520963843072:12345-192.168.203.57@tcp:35:umount.0 Request processed in 363us (1004us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1788636462.647133:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 69 00000100:00100000:3.0:1788636462.657537:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636462.657584:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636462.657632:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636462.657767:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963843456 00000100:00100000:1.0:1788636462.657777:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963843456 00000100:00100000:1.0:1788636462.657874:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963843712 00000100:00100000:1.0:1788636462.657878:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963843712 00000100:00100000:1.0:1788636462.657891:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963843584 00000100:00100000:1.0:1788636462.657893:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963843584 00000100:00100000:1.0:1788636462.657908:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:1.0:1788636462.657917:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+15:2360:x1875520963843456:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636462.657931:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636462.657961:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997c000/0xa6aa59fb12fa72cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155464 expref: 15 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636462.657988:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636462.658036:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+14:2360:x1875520963843456:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 119us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636462.658043:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:1.0:1788636462.658060:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:1.0:1788636462.658067:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+13:2360:x1875520963843712:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636462.658075:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636462.658085:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40030600/0xa6aa59fb12fa74e1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515552f expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636462.658095:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636462.658114:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5df100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+12:2360:x1875520963843712:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 47us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636462.658120:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:1.0:1788636462.658133:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:1.0:1788636462.658138:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+11:2360:x1875520963843584:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636462.658145:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636462.658154:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031c00/0xa6aa59fb12fa7233 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515542c expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636462.658163:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636462.658178:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+10:2360:x1875520963843584:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 40us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636462.658184:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:1.0:1788636462.701784:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636462.701871:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636462.701953:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963844096 00000100:00100000:2.0:1788636462.701963:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963844096 00000100:00100000:2.0:1788636462.702037:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 167 00000100:00100000:2.0:1788636462.702047:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2361:x1875520963844096:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636462.702121:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2361:x1875520963844096:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 75us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636462.702128:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 167 00000100:00100000:3.0:1788636462.702432:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963843840 00000100:00100000:3.0:1788636462.702436:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963843840 00000100:00100000:3.0:1788636462.702478:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 73 00000100:00100000:3.0:1788636462.702487:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+7:2359:x1875520963843840:12345-192.168.203.57@tcp:9:umount.0 00000020:00000080:3.0:1788636462.702507:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7806 00000020:00010000:3.0:1788636462.702515:0:6661:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cfd6f5e5000: total 0 00000100:00080000:3.0:1788636462.702519:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9cfd6f5e0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788636462.702557:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788636462.702842:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:38630149-ece4-4de3-88b1-a62e16a39489+5:2359:x1875520963843840:12345-192.168.203.57@tcp:9:umount.0 Request processed in 356us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636462.702850:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 73 00000020:00010000:3.0:1788636462.702867:0:11147:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cfd6f5e5000: total 0 00010000:00010000:3.0:1788636462.702890:0:11147:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cfd6f5e5000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1788636462.702944:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030ccad80/0xa6aa59fb12fa8247 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558d2 expref: 4 pid: 6661 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636462.702978:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa7ba9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155704 expref: 3 pid: 6659 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636462.702993:0:11147:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cfd6f5e5000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788636462.703003:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636462.703005:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636462.703020:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636462.703222:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788636462.703227:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636462.707619:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636462.707696:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963843968 00000100:00100000:2.0:1788636462.707717:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963843968 00000100:00100000:2.0:1788636462.707830:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 74 00000100:00100000:2.0:1788636462.707841:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+5:2359:x1875520963843968:12345-192.168.203.57@tcp:9:kworker.0 00000020:00000080:2.0:1788636462.707870:0:6963:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa75a5 00000100:00080000:2.0:1788636462.707891:0:6963:0:(import.c:65:import_set_state_nolock()) ffff9cfd75bc2000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788636462.707936:0:6963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788636462.708183:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:38630149-ece4-4de3-88b1-a62e16a39489+2:2359:x1875520963843968:12345-192.168.203.57@tcp:9:kworker.0 Request processed in 343us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636462.708191:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 74 00010000:00010000:3.0:1788636462.708659:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636462.708898:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788636462.721521:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636462.736257:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636462.736387:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963845120 00000100:00100000:2.0:1788636462.736396:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963845120 00000100:00100000:2.0:1788636462.736463:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 240 00000100:00100000:2.0:1788636462.736473:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+22:2359:x1875520963845120:12345-192.168.203.57@tcp:39:umount.0 00000020:00000080:2.0:1788636462.736514:0:5812:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7241 00000020:00010000:2.0:1788636462.736538:0:5812:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cfd7fe7b000: total 0 00000100:00080000:2.0:1788636462.736542:0:5812:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fe79000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788636462.736573:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:2.0:1788636462.736980:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75a45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:38630149-ece4-4de3-88b1-a62e16a39489+21:2359:x1875520963845120:12345-192.168.203.57@tcp:39:umount.0 Request processed in 506us (729us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788636462.736988:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 240 00000020:00010000:0.0:1788636462.737654:0:11147:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cfd7fe7b000: total 0 00010000:00010000:0.0:1788636462.737701:0:11147:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cfd7fe7b000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788636462.737747:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:0.0:1788636462.737750:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788636462.737759:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eae00/0xa6aa59fb12fa7868 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515562b expref: 20 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737777:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cfd5a43c400) 00010000:00010000:0.0:1788636462.737779:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636462.737783:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a600/0xa6aa59fb12fa750b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515553d expref: 19 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737840:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636462.737844:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788636462.737848:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eac00/0xa6aa59fb12fa7b94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556fd expref: 18 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737862:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636462.737865:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788636462.737869:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997c400/0xa6aa59fb12fa7f06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351557f9 expref: 17 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737882:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636462.737885:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788636462.737903:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd5997d600/0xa6aa59fb12fa8232 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558cb expref: 16 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737919:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cfd500ebf00) 00010000:00010000:0.0:1788636462.737921:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788636462.737925:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d800/0xa6aa59fb12fa7c27 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155727 expref: 15 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737938:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636462.737940:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636462.737943:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d600/0xa6aa59fb12fa7a8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556b7 expref: 14 pid: 5810 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737952:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cfd500eb000) 00010000:00010000:0.0:1788636462.737954:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788636462.737957:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c000/0xa6aa59fb12fa757b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155559 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737969:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636462.737972:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636462.737975:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4ea200/0xa6aa59fb12fa8128 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155885 expref: 12 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.737986:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd5a43c200) 00010000:00010000:0.0:1788636462.737988:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636462.737991:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa7527 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155544 expref: 11 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.738002:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cfd42a85400) 00010000:00010000:0.0:1788636462.738009:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636462.738022:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa8208 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558bd expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.738039:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:0.0:1788636462.738042:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636462.738045:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb600/0xa6aa59fb12fa7c0b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155720 expref: 9 pid: 7975 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.738056:0:11147:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cfd500eb700) 00010000:00010000:0.0:1788636462.738059:0:11147:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636462.738062:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eba00/0xa6aa59fb12fa7b6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351556ef expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636462.738074:0:11147:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cfd7fe7b000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788636462.738087:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636462.738089:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636462.738091:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788636463.310550:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967523 is committed 00000001:00100000:0.0:1788636463.310572:0:5832:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000001:00080000:0.0:1788636463.310578:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:0.0:1788636463.310584:0:5832:0:(genops.c:885:class_export_put()) final put ffff9cfd7fe7b000/38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:0.0:1788636463.310608:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7fe7b000/38630149-ece4-4de3-88b1-a62e16a39489 for lustre-MDT0000 00000020:00000080:0.0:1788636463.310664:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd7fe79000 for lustre-MDT0000 00000001:00100000:3.0:1788636463.313388:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:3.0:1788636463.313395:0:7625:0:(genops.c:885:class_export_put()) final put ffff9cfd6f5e5000/38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:0.0:1788636463.313526:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd6f5e5000/38630149-ece4-4de3-88b1-a62e16a39489 for lustre-OST0001 00000020:00000080:0.0:1788636463.313568:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd6f5e0000 for lustre-OST0001 00010000:00010000:2.0:1788636463.745295:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636464.767347:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636464.767431:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636464.767567:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976407040:0@lo:400:kworker.0 00000100:00100000:1.0:1788636464.767638:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636464.767714:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976406912:0@lo:400:kworker.0 00000100:00100000:2.0:1788636464.767731:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976407040 00000100:00100000:2.0:1788636464.767739:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976407040 00000100:00100000:1.0:1788636464.767747:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636464.767790:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788636464.767824:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976407040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636464.767884:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976407040:12345-0@lo:400:kworker.0 Request processed in 61us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636464.767891:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788636464.767893:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976406912 00000100:00100000:3.0:1788636464.767899:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976406912 00000100:00100000:3.0:1788636464.767935:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1788636464.767945:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976406912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636464.767982:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69979c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976406912:12345-0@lo:400:kworker.0 Request processed in 40us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636464.768000:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1788636464.768090:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976407040:0@lo:400:kworker.0 00000100:00100000:1.0:1788636464.768100:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976406912:0@lo:400:kworker.0 00000100:00100000:1.0:1788636464.768404:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976407168:0@lo:400:kworker.0 00000100:00100000:1.0:1788636464.768431:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636464.768490:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976407168 00000100:00100000:2.0:1788636464.768495:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976407168 00000100:00100000:3.0:1788636464.768527:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976407296:0@lo:400:kworker.0 00000100:00100000:2.0:1788636464.768541:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788636464.768550:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976407168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636464.768563:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636464.768612:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976407296 00000100:00100000:3.0:1788636464.768616:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976407296 00000100:00100000:3.0:1788636464.768646:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636464.768655:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976407296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636464.768702:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976407296:12345-0@lo:400:kworker.0 Request processed in 39us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636464.768709:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788636464.768737:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976407296:0@lo:400:kworker.0 00000100:00080000:3.0:1788636464.768764:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788636464.768769:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636464.768891:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976407552:0@lo:400:kworker.0 00000100:00100000:0.0:1788636464.768919:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636464.768949:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788636464.768955:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976407424:0@lo:400:kworker.0 00000100:00100000:0.0:1788636464.768979:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636464.769023:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976407552 00000100:00100000:0.0:1788636464.769027:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976407552 00000100:00100000:0.0:1788636464.769067:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788636464.769075:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976407552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636464.769111:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75b98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976407552:12345-0@lo:400:kworker.0 Request processed in 37us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636464.769116:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788636464.769145:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976407552:0@lo:400:kworker.0 00000100:00080000:3.0:1788636464.769202:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636464.769219:0:7975:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976407424 00000100:00100000:3.0:1788636464.769223:0:7975:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976407424 00000100:00100000:3.0:1788636464.769259:0:7975:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788636464.769265:0:7975:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd818dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976407424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636464.769305:0:7975:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd818dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976407424:12345-0@lo:400:kworker.0 Request processed in 40us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636464.769312:0:7975:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788636464.769324:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976407168:12345-0@lo:400:kworker.0 Request processed in 774us (890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636464.769331:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:0.0:1788636464.769479:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636464.769497:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976407424:0@lo:400:kworker.0 00000100:00100000:1.0:1788636464.769560:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976407168:0@lo:400:kworker.0 00000100:00100000:3.0:1788636465.279746:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636465.279770:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976407680:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636465.279858:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636465.279929:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976407680 00000100:00100000:3.0:1788636465.279938:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976407680 00000100:00100000:3.0:1788636465.279996:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788636465.280171:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976407680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788636465.280205:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636465.280253:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976407680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 248us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636465.280262:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788636465.280374:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976407680:0@lo:13:osp-pre-1-0.0 00000001:00100000:0.0:1788636465.320440:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:0.0:1788636465.320450:0:6685:0:(genops.c:885:class_export_put()) final put ffff9cfd75bc4800/38630149-ece4-4de3-88b1-a62e16a39489 00000020:00000080:2.0:1788636465.320502:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd75bc4800/38630149-ece4-4de3-88b1-a62e16a39489 for lustre-OST0000 00000020:00000080:2.0:1788636465.320548:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd75bc2000 for lustre-OST0000 00010000:00010000:0.0:1788636465.791009:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636466.068098:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636466.068145:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636466.068233:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963845376 00000100:00100000:1.0:1788636466.068243:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963845376 00000100:00100000:1.0:1788636466.068307:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963845248 00000100:00100000:1.0:1788636466.068311:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963845248 00000100:00100000:1.0:1788636466.068341:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:1.0:1788636466.068351:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+11:2361:x1875520963845376:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636466.068366:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636466.068383:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521ffc00/0xa6aa59fb12fa731a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351554a3 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636466.068418:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636466.068469:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+10:2361:x1875520963845376:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 119us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636466.068477:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:1.0:1788636466.068493:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:1.0:1788636466.068500:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+9:2360:x1875520963845248:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636466.068508:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636466.068517:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd820fc200/0xa6aa59fb12fa7313 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155479 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636466.068527:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636466.068544:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+8:2360:x1875520963845248:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 45us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636466.068550:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:1.0:1788636466.069919:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636466.072278:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963845504 00000100:00100000:2.0:1788636466.072291:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963845504 00000100:00100000:2.0:1788636466.072370:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:2.0:1788636466.072381:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+8:2362:x1875520963845504:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788636466.072396:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636466.072415:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997de00/0xa6aa59fb12fa74da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155528 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636466.072433:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636466.072498:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5e9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:003dba47-3849-46de-b5b5-7b33358ec353+7:2362:x1875520963845504:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 120us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636466.072506:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:1.0:1788636466.085894:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636466.086025:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963845760 00000100:00100000:3.0:1788636466.086035:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963845760 00000100:00080000:0.0:1788636466.086106:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636466.086125:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 241 00000100:00100000:3.0:1788636466.086138:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7a1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+6:2359:x1875520963845760:12345-192.168.203.57@tcp:39:umount.0 00000020:00000080:3.0:1788636466.086182:0:5811:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7328 00000020:00010000:3.0:1788636466.086191:0:5811:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cfd818f7800: total 0 00000100:00080000:3.0:1788636466.086195:0:5811:0:(import.c:65:import_set_state_nolock()) ffff9cfd818f2800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788636466.086225:0:5811:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:0.0:1788636466.086239:0:5798:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cfd818f7800: total 0 00010000:00010000:0.0:1788636466.086245:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636466.086297:0:5798:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cfd818f7800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788636466.086358:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd62575200) 00010000:00010000:0.0:1788636466.086362:0:5798:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788636466.086371:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd6f4eb800/0xa6aa59fb12fa8255 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558d9 expref: 5 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636466.086396:0:5798:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cfd818f7800, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788636466.086410:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636466.086425:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636466.086428:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636466.086693:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7a1b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:05d1767c-40ac-4b63-986f-dfff0e865a57+3:2359:x1875520963845760:12345-192.168.203.57@tcp:39:umount.0 Request processed in 549us (800us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788636466.086702:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 241 00000100:00100000:3.0:1788636466.110002:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636466.110146:0:5803:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963846016 00000100:00100000:0.0:1788636466.110156:0:5803:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963846016 00000100:00100000:0.0:1788636466.110213:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 302 00000100:00100000:0.0:1788636466.110225:0:5803:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+7:2359:x1875520963846016:12345-192.168.203.57@tcp:251:umount.0 00000020:00000080:0.0:1788636466.110269:0:5803:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa721e 00000020:00010000:0.0:1788636466.110277:0:5803:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cfd76a37000: total 0 00000100:00080000:0.0:1788636466.110282:0:5803:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a34000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788636466.110360:0:5803:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6997a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:003dba47-3849-46de-b5b5-7b33358ec353+3:2359:x1875520963846016:12345-192.168.203.57@tcp:251:umount.0 Request processed in 138us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636466.110367:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 302 00000020:00010000:1.0:1788636466.110545:0:5799:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cfd76a37000: total 0 00010000:00010000:1.0:1788636466.110591:0:5799:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cfd76a37000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788636466.110626:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fe000/0xa6aa59fb12fa72d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515546b expref: 2 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636466.110641:0:5799:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cfd76a37000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788636466.110650:0:5799:0:(genops.c:885:class_export_put()) final put ffff9cfd76a37000/003dba47-3849-46de-b5b5-7b33358ec353 00010000:00010000:1.0:1788636466.110664:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636466.110666:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636466.110668:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788636466.110786:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd76a37000/003dba47-3849-46de-b5b5-7b33358ec353 for MGS 00000020:00000080:0.0:1788636466.111222:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd76a34000 for MGS 00000040:00080000:1.0:1788636466.691385:0:11663:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788636466.691394:0:11663:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788636466.692131:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788636466.692142:0:11663:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788636466.815134:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636466.819619:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636466.822787:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976407808:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636466.822959:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636466.823399:0:6663:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976407808 00000100:00100000:3.0:1788636466.823408:0:6663:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976407808 00000100:00100000:3.0:1788636466.823477:0:6663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636466.823488:0:6663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976407808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636466.823599:0:6663:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788636466.823829:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788636466.823986:0:6663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75867b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976407808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 499us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636466.823993:0:6663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788636466.824432:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976407808:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788636467.838935:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788636468.384560:0:5832:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 05d1767c-40ac-4b63-986f-dfff0e865a57 00000001:00080000:0.0:1788636468.384578:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788636468.384584:0:5832:0:(genops.c:885:class_export_put()) final put ffff9cfd818f7800/05d1767c-40ac-4b63-986f-dfff0e865a57 00000020:00000080:0.0:1788636468.384829:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd818f7800/05d1767c-40ac-4b63-986f-dfff0e865a57 for lustre-MDT0000 00000020:00000080:0.0:1788636468.384881:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd818f2800 for lustre-MDT0000 00000020:01000004:2.0:1788636468.547907:0:13060:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788636468.566924:0:13060:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788636468.566970:0:13060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.566982:0:13060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.567001:0:13060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.567006:0:13060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.567026:0:13060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788636468.567031:0:13060:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788636468.567059:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788636468.567064:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788636468.567069:0:13060:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788636468.567093:0:13060:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a31800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788636468.568142:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636468.568151:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.568160:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167cc00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636468.568163:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.568182:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636468.568189:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636468.568195:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788636468.568198:0:5799:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788636468.568200:0:5799:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788636468.568226:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.568232:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636468.568252:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.568260:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167cc00/0xa6aa59fb12fa72a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa72aa expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.568272:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636468.568273:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636468.568275:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636468.568297:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976408064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636468.568359:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636468.568424:0:6675:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976408064 00000100:00100000:2.0:1788636468.568430:0:6675:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976408064 00000100:00100000:2.0:1788636468.568477:0:6675:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788636468.568486:0:6675:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+19:3282:x1875520976408064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636468.568499:0:6675:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636468.568520:0:6675:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997c600/0xa6aa59fb12fa72aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa72a3 expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.568532:0:6675:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636468.568569:0:6675:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69ac4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:1196c107-eaca-4490-96fc-d60d67da8edc+18:3282:x1875520976408064:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636468.568576:0:6675:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788636468.568639:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976408064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636468.572491:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976407936:0@lo:39:umount.0 00000100:00100000:1.0:1788636468.572564:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636468.573216:0:5810:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976407936 00000100:00100000:2.0:1788636468.573226:0:5810:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976407936 00000100:00100000:2.0:1788636468.573283:0:5810:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788636468.573294:0:5810:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd75866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875520976407936:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788636468.573322:0:5810:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa702d 00000100:00080000:2.0:1788636468.573330:0:5810:0:(import.c:65:import_set_state_nolock()) ffff9cfd8151b000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788636468.573404:0:5810:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd75866300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3279:x1875520976407936:12345-0@lo:39:umount.0 Request processed in 113us (840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636468.573411:0:5810:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788636468.573423:0:5810:0:(genops.c:885:class_export_put()) final put ffff9cfd8151a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788636468.575972:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788636468.576905:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd8151a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788636468.576969:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd8151b000 for lustre-MDT0000 00000100:00080000:1.0:1788636468.578528:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a31800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788636468.578548:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976407936:0@lo:39:umount.0 00000100:00080000:0.0:1788636468.580041:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788636468.580047:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788636468.580053:0:13060:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788636468.585408:0:13060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.587932:0:13060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.587942:0:13060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.587949:0:13060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.587990:0:13060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636468.587999:0:13060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588005:0:13060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588011:0:13060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588017:0:13060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588028:0:13060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788636468.588034:0:13060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588041:0:13060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588047:0:13060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588053:0:13060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588070:0:13060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788636468.588075:0:13060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588097:0:13060:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588103:0:13060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588109:0:13060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636468.588117:0:13060:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:0.0:1788636468.588120:0:13060:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788636468.588154:0:13060:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788636468.588158:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788636468.588162:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788636468.588167:0:13060:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788636468.588184:0:13060:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cfd75eaf800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788636468.588190:0:13060:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9cfd7fd0d000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788636468.588195:0:13060:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9cfd7a5419c0) has exports, disconnecting them 00000020:00080000:0.0:1788636468.588204:0:13060:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cfd75eaf800), last request at 1788636464 00000020:00000080:0.0:1788636468.588212:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa71a0 00000100:00080000:0.0:1788636468.588234:0:13060:0:(import.c:65:import_set_state_nolock()) ffff9cfd75eaf000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788636468.588728:0:11147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788636468.588737:0:11147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.588747:0:11147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd4167d200 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:3.0:1788636468.588750:0:11147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.588759:0:11147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636468.588767:0:11147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1788636468.588940:0:13060:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cfd75eaf800): rc 0 00000020:00000080:0.0:1788636468.588943:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd75eaf800/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1788636468.589363:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788636468.589371:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589380:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40030c00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636468.589384:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589392:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636468.589408:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 10000000:00010000:2.0:1788636468.589419:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636468.589426:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788636468.589429:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00000020:00080000:0.0:1788636468.589447:0:13060:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cfd7fd0d000), last request at 1788636464 00000020:00000080:0.0:1788636468.589454:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa70d5 00000100:00080000:0.0:1788636468.589464:0:13060:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fd08000 : changing import state from FULL to CLOSED 00000020:00000080:0.0:1788636468.589478:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd75eaf800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788636468.589522:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd75eaf000 for lustre-MDT0000 00000020:00080000:0.0:1788636468.589539:0:13060:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cfd7fd0d000): rc 0 00000020:00000080:0.0:1788636468.589541:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd7fd0d000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788636468.589557:0:13060:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb0a5c0c97ae0 00000020:00000080:0.0:1788636468.589567:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7fd0d000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 10000000:01000000:2.0:1788636468.589582:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00000020:00000080:0.0:1788636468.589597:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd7fd08000 for lustre-MDT0000 00010000:00010000:2.0:1788636468.589623:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788636468.589623:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788636468.589629:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00010000:00010000:2.0:1788636468.589633:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000004:00080000:0.0:1788636468.589656:0:13060:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1788636468.589658:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589678:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd40030c00/0xa6aa59fb12fa71d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa71df expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589696:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636468.589700:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589792:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d800 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636468.589811:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589819:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636468.589826:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636468.589841:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788636468.589844:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788636468.589846:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788636468.589861:0:5798:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589867:0:5798:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636468.589883:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589890:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa6f8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa6f93 expref: -99 pid: 5791 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.589907:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636468.589910:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636468.589912:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636468.589928:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976408192:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636468.589990:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636468.589995:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636468.589998:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636468.590007:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40030a00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636468.590011:0:5799:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636468.590019:0:5799:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636468.590026:0:5799:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636468.590032:0:5799:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788636468.590035:0:5799:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788636468.590037:0:5799:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:2.0:1788636468.590056:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976408320:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636468.590059:0:5799:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636468.590067:0:5799:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636468.590076:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636468.590084:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788636468.590094:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd40030a00/0xa6aa59fb12fa74cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa74d3 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636468.590111:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636468.590114:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636468.590117:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788636468.590124:0:11147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788636468.590124:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 10000000:01000000:3.0:1788636468.590127:0:11147:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:3.0:1788636468.590129:0:11147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000100:00100000:2.0:1788636468.590132:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976408448:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636468.590133:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976408192 00000100:00100000:1.0:1788636468.590140:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976408192 00010000:00010000:3.0:1788636468.590157:0:11147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636468.590158:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636468.590173:0:11147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788636468.590189:0:11147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636468.590190:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976408320 00000100:00100000:2.0:1788636468.590194:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976408320 00000100:00100000:1.0:1788636468.590194:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976408448 00010000:00010000:3.0:1788636468.590196:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167d200/0xa6aa59fb12fa72b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa72b8 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636468.590200:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976408448 00010000:00010000:3.0:1788636468.590210:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636468.590214:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636468.590215:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636468.590221:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788636468.590233:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+20:3283:x1875520976408192:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636468.590237:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788636468.590243:0:6675:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788636468.590248:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+20:3280:x1875520976408320:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636468.590252:0:6675:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00010000:00010000:2.0:1788636468.590256:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636468.590260:0:5795:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636468.590270:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031200/0xa6aa59fb12fa71df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa71d8 expref: 20 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.590284:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636468.590285:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976408576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636468.590307:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636468.590311:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3283:x1875520976408192:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636468.590318:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636468.590750:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976408192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636468.590875:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976408576 00000100:00100000:3.0:1788636468.590879:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976408576 00000100:00100000:2.0:1788636468.591012:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788636468.591019:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+19:3280:x1875520976408448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636468.591027:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636468.591037:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fec00/0xa6aa59fb12fa74d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa74cc expref: 19 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.591045:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636468.591074:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+18:3280:x1875520976408448:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (916us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636468.591080:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788636468.591091:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788636468.591096:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+17:3282:x1875520976408576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636468.591103:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636468.591110:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521ff400/0xa6aa59fb12fa72b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa72b1 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636468.591118:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788636468.591139:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:1196c107-eaca-4490-96fc-d60d67da8edc+16:3282:x1875520976408576:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636468.591155:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00010000:1.0:1788636468.591167:0:5795:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031400/0xa6aa59fb12fa6f93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa6f8c expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636468.591193:0:5795:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636468.591229:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1196c107-eaca-4490-96fc-d60d67da8edc+14:3280:x1875520976408320:12345-0@lo:103:ldlm_bl.0 Request processed in 982us (1143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636468.591236:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788636468.591288:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636468.591291:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636468.591437:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976408576:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636468.591465:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976408448:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636468.591474:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b73100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:1196c107-eaca-4490-96fc-d60d67da8edc:3280:1875520976408320:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1788636468.592160:0:13060:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788636468.592182:0:13060:0:(import.c:65:import_set_state_nolock()) ffff9cfd7a191800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788636468.592208:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788636468.592211:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000100:00100000:1.0:1788636468.592297:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976408704:0@lo:9:umount.0 00000100:00100000:1.0:1788636468.592337:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636468.592374:0:6661:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976408704 00000100:00100000:1.0:1788636468.592387:0:6661:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976408704 00000100:00100000:1.0:1788636468.592440:0:6661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788636468.592448:0:6661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3279:x1875520976408704:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788636468.592476:0:6661:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7122 00000100:00080000:1.0:1788636468.592482:0:6661:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fcf4000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788636468.592514:0:6661:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:2.0:1788636468.593870:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:0.0:1788636468.593974:0:13060:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788636468.594142:0:13060:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788636468.594168:0:13060:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fd0c800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788636468.594210:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976408832:0@lo:9:umount.0 00000020:00080000:0.0:1788636468.594210:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cfd7a5419c0) has no exports 00000100:00100000:2.0:1788636468.594262:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636468.594346:0:6963:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976408832 00000100:00100000:0.0:1788636468.594353:0:6963:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976408832 00000100:00100000:0.0:1788636468.594521:0:6963:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788636468.594531:0:6963:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3279:x1875520976408832:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788636468.594552:0:6963:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7209 00000100:00080000:0.0:1788636468.594559:0:6963:0:(import.c:65:import_set_state_nolock()) ffff9cfd613b8800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788636468.594590:0:6963:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1788636468.594975:0:6661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3279:x1875520976408704:12345-0@lo:9:umount.0 Request processed in 2526us (2635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636468.594984:0:6661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:1.0:1788636468.595012:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636468.595018:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636468.595039:0:6963:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3279:x1875520976408832:12345-0@lo:9:umount.0 Request processed in 508us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636468.595047:0:6963:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1788636468.595065:0:5806:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636468.597523:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd7a191800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788636468.597537:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788636468.597546:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788636468.597552:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976408704:0@lo:9:umount.0 00000100:00080000:2.0:1788636468.597578:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fd0c800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788636468.597587:0:3279:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788636468.597588:0:3279:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788636468.597590:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976408832:0@lo:9:umount.0 00000020:00080000:2.0:1788636468.605246:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9cfd7a5419c0) has no exports 00000020:00000080:2.0:1788636468.636451:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6fe7 00000020:00000080:2.0:1788636468.636466:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd75a66800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788636468.636490:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788636468.636571:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd75a66800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788636468.636748:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636468.636758:0:13060:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788636468.636763:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9cfd5d208000) has no exports 00000020:00000080:3.0:1788636468.637177:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6fe0 00000020:00000080:3.0:1788636468.637196:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd76a17800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788636468.637245:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd76a17800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788636468.637298:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636468.637305:0:13060:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788636468.637307:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd7a538000/lustre-QMT0000_UUID 00000020:00000080:3.0:1788636468.637310:0:13060:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7a538000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788636468.637316:0:13060:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1788636468.638930:0:13060:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cfd497d7a20 - data ffff9cfc415ccbd0/ffff9cfc41ab8c00 00000020:01000000:3.0:1788636468.639089:0:13060:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cfd47cb8d80 - data ffff9cfd6c3681b0/ffff9cfd6f4cdc00 00000001:00000004:3.0:1788636468.652936:0:13060:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:0.0:1788636468.718903:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788636468.718911:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1788636468.718926:0:13060:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788636468.718928:0:13060:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788636468.720037:0:6961:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788636468.720044:0:6961:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788636468.720056:0:6961:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1788636468.721200:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788636468.721205:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:0.0:1788636468.721216:0:13060:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788636468.721218:0:13060:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788636468.721679:0:7973:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788636468.721683:0:7973:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788636468.721691:0:7973:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788636468.837593:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6faf 00000020:00000080:3.0:1788636468.837617:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd43ef7800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788636468.838790:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd43ef7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788636468.840455:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6fc4 00000020:00000080:3.0:1788636468.840465:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd7a551800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788636468.840559:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788636468.840565:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636468.840574:0:13060:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788636468.840578:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9cfd7a540000) has no exports 00000004:01000000:3.0:1788636468.840762:0:13060:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788636468.840771:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7202 00000020:00000080:3.0:1788636468.840776:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd76a30800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788636468.841700:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7a551800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788636468.841783:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788636468.841789:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788636468.841861:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd76a30800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788636468.841903:0:13060:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788636468.841908:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9cfd61340000) has no exports 00000020:00000080:3.0:1788636468.841916:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa71fb 00000020:00000080:3.0:1788636468.841923:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd7fd09800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788636468.842048:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7fd09800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788636468.853409:0:13060:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788636468.853418:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788636468.853422:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1788636468.853431:0:13060:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788636468.853433:0:13060:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788636468.853956:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636468.853980:0:13060:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636468.854000:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa711b 00000020:00000080:3.0:1788636468.854012:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd76a33000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788636468.859356:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd7fd0c800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1788636468.859374:0:37:0:(genops.c:885:class_export_put()) final put ffff9cfd76a32000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788636468.859377:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd76a32000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1788636468.859385:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00010000:00010000:2.0:1788636468.863595:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788636468.865066:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788636468.865113:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636468.865127:0:13060:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788636468.865132:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9cfd76a53380) has no exports 00000020:00000080:3.0:1788636468.865141:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7114 00000020:00000080:2.0:1788636468.865274:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd76a33000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788636468.865351:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd7a190800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1788636468.866262:0:13060:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788636468.866267:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788636468.866271:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788636468.866277:0:13060:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788636468.866280:0:13060:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788636468.868869:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7a190800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788636468.870645:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636468.870661:0:13060:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636468.870707:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636468.870711:0:13060:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636468.870717:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd60559000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788636468.870721:0:13060:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd60559000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788636468.870733:0:13060:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788636468.870927:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd7a191800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788636468.870936:0:37:0:(genops.c:885:class_export_put()) final put ffff9cfd74e16000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788636468.870939:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd74e16000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788636468.870956:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788636468.873229:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6fcb 00000020:00000080:2.0:1788636468.873241:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd7a550800/lustre-MDD0000_UUID 00000020:01000000:2.0:1788636468.873263:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788636468.873268:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636468.873275:0:13060:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788636468.873279:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9cfd7a544d40) has no exports 00000020:00000080:2.0:1788636468.873312:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636468.873317:0:13060:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788636468.873321:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6fd2 00000020:00000080:2.0:1788636468.873325:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd7a556000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788636468.873331:0:13060:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd613a5000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788636468.873334:0:13060:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd613a5000 3 00000020:01000004:2.0:1788636468.873337:0:13060:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cfd613a5000 from lustre-MDT0000 00000020:00000080:2.0:1788636468.873353:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636468.873356:0:13060:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788636468.873358:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd43ef5000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788636468.873361:0:13060:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd43ef5000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788636468.873370:0:13060:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788636468.873404:0:13060:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788636468.873409:0:13060:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788636468.873412:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788636468.873415:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636468.873417:0:13060:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788636468.873423:0:13060:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9cfd60e80000 1196c107-eaca-4490-96fc-d60d67da8edc 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788636468.873428:0:13060:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9cfd48dccd40) has exports, disconnecting them 00000020:00080000:2.0:1788636468.873433:0:13060:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9cfd60e80000), last request at 1788636244 00000020:00000080:2.0:1788636468.873444:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6f70 00000020:00010000:2.0:1788636468.873448:0:13060:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9cfd60e80000: total 2 00000100:00080000:2.0:1788636468.873452:0:13060:0:(import.c:65:import_set_state_nolock()) ffff9cfd60e87800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788636468.873466:0:13060:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cfd60e80000): rc 0 00000020:00080000:2.0:1788636468.873482:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9cfd48dccd40) has no exports 00000100:00100000:2.0:1788636468.873539:0:5805:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cfd60f78a00:5805] 2 exiting: rc = 0 00000100:00100000:2.0:1788636468.873615:0:5804:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cfd60f79600:5804] 1 exiting: rc = 0 00000100:00100000:0.0:1788636468.873717:0:5803:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cfd60f79a00:5803] 0 exiting: rc = 1 00000020:00000080:0.0:1788636468.873768:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7a550800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788636468.873773:0:37:0:(genops.c:885:class_export_put()) final put ffff9cfd51109800/lustre-MDD0000_UUID 00000020:00000080:0.0:1788636468.873775:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd51109800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1788636468.873782:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000100:00100000:2.0:1788636468.873984:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788636468.874010:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7a556000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:2.0:1788636468.874059:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874066:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874072:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874228:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874236:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874243:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874248:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874254:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874261:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874266:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874271:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874277:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874282:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874288:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874292:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874298:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874303:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874308:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874314:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874319:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874325:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874330:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874335:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874340:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874345:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874351:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874356:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874362:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874367:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874372:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.874385:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00010000:3.0:1788636468.874472:0:13061:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9cfd60e80000: total 0 00010000:00010000:3.0:1788636468.874625:0:13061:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cfd60e80000, canceled 0 locks, left on hash table 8. 00010000:00010000:3.0:1788636468.874652:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167de00/0xa6aa59fb12fa7272 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa726b expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.874689:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167c000/0xa6aa59fb12fa728e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa7287 expref: 8 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.874702:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fe600/0xa6aa59fb12fa7280 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa7279 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.874726:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd40031000/0xa6aa59fb12fa74b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa74b0 expref: 6 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.874736:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521fee00/0xa6aa59fb12fa729c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa7295 expref: 5 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.874817:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd4167d400/0xa6aa59fb12fa7088 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa7081 expref: 4 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.874831:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa72c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa72bf expref: 3 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.874844:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd521ff600/0xa6aa59fb12fa74c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xa6aa59fb12fa74be expref: 2 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636468.874854:0:13061:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cfd60e80000, canceled 8 locks, left on hash table 0. 00000020:00000080:3.0:1788636468.874867:0:13061:0:(genops.c:885:class_export_put()) final put ffff9cfd60e80000/1196c107-eaca-4490-96fc-d60d67da8edc 00010000:00010000:3.0:1788636468.874881:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636468.874884:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636468.874886:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788636468.874958:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd60e80000/1196c107-eaca-4490-96fc-d60d67da8edc for MGS 00000020:00000080:0.0:1788636468.874993:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd60e87800 for MGS 00000100:00100000:2.0:1788636468.875259:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875266:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875271:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875276:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875281:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875286:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875292:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875297:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875302:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875307:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875313:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875318:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875323:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875328:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875334:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875339:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875360:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875365:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875371:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875376:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875381:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.875386:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876631:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876640:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876647:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876654:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876660:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876675:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876681:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876687:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876694:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636468.876700:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788636468.879198:0:13060:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788636468.879205:0:13060:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1788636468.880980:0:13060:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cfd7395f660 - data ffff9cfc414fa6c0/ffff9cfd7fcba800 00000020:01000000:2.0:1788636468.881133:0:13060:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cfd42cfcde0 - data ffff9cfd6c3ed1b0/ffff9cfd5a2d6c00 00000020:00000080:2.0:1788636468.882149:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6f54 00000020:00000080:2.0:1788636468.882157:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd613a0000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788636468.882261:0:13060:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd613a5000 from MGS, refs=2 00000020:01000004:2.0:1788636468.882265:0:13060:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd613a5000 2 00000020:01000004:2.0:1788636468.882269:0:13060:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cfd613a5000 from MGS 00000020:00000080:2.0:1788636468.882294:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636468.882311:0:13060:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1788636468.882314:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd613a7800/MGS 00000020:00000080:2.0:1788636468.882317:0:13060:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd613a7800/MGS for MGS 00000020:01000000:2.0:1788636468.882324:0:13060:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1788636468.882380:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1788636468.882385:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636468.882390:0:13060:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788636468.882398:0:13060:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cfd76a33800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788636468.882404:0:13060:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9cfd76a54d40) has exports, disconnecting them 00000020:00080000:2.0:1788636468.882408:0:13060:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cfd76a33800), last request at 1788636245 00000020:00000080:2.0:1788636468.882413:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa701f 00000020:00080000:2.0:1788636468.882423:0:13060:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cfd76a33800): rc 0 00000020:00000080:2.0:1788636468.882427:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd76a33800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788636468.888464:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd613a0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788636468.894766:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd76a33800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788636468.925863:0:13060:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788636468.925872:0:13060:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788636468.925877:0:13060:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788636468.925929:0:13060:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788636468.926130:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636468.926140:0:13060:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788636468.926155:0:13060:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd613a5000 1 00000020:00000080:2.0:1788636468.926162:0:13060:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6f46 00000020:00000080:2.0:1788636468.926178:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd613a5800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788636468.926184:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788636468.926198:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636468.926202:0:13060:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788636468.926205:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9cfd48dc99c0) has no exports 00000020:00000080:0.0:1788636468.926523:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd76a31800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1788636468.926536:0:38:0:(genops.c:885:class_export_put()) final put ffff9cfd74e10800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1788636468.926539:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd74e10800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1788636468.926546:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1788636468.926622:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd613a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788636469.027991:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636469.028005:0:13060:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788636469.028011:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd613a2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788636469.028015:0:13060:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd613a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788636469.028025:0:13060:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788636469.029069:0:13060:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cfd613a1000 00000020:01000000:2.0:1788636469.029164:0:13060:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1788636469.029169:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636469.029518:0:13060:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788636469.029524:0:13060:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9cfd5d20b380) has no exports 00000100:00100000:2.0:1788636469.029605:0:7975:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9cfd45351800:7975] 3 exiting: rc = 0 00000100:00100000:1.0:1788636469.029742:0:5812:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9cfd5d07f400:5812] 2 exiting: rc = 0 00000100:00100000:2.0:1788636469.030310:0:5810:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9cfd5d293e00:5810] 0 exiting: rc = 1 00000100:00100000:3.0:1788636469.030694:0:5811:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9cfd5d07fa00:5811] 1 exiting: rc = 0 00000100:00100000:2.0:1788636469.031053:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031063:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031071:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031079:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031087:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031095:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031103:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031111:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031133:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031142:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031149:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031156:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.031163:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.032987:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033002:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033007:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033013:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033018:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033024:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033040:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033045:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033051:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033056:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033062:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033069:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033074:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033090:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033098:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033103:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033108:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033113:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033118:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033124:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033129:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033135:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033140:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033145:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033151:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.033156:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034035:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034048:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034055:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034063:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034070:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034650:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034662:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034680:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034687:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034694:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034702:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034708:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034715:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034722:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034730:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034749:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034756:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034766:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034786:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034811:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034820:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034828:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034836:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034843:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.034849:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.054015:0:5813:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cfd5d07e200:5813] 0 exiting: rc = 1 00000100:00100000:0.0:1788636469.054108:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9cfd5d07f600:5814] 1 exiting: rc = 0 00000100:00100000:2.0:1788636469.055486:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055501:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055508:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055513:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055519:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055524:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055529:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055535:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055545:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055550:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055556:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055631:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055639:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055646:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055653:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055659:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055730:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055739:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055746:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055753:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055760:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055766:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055773:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055779:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055789:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055832:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055837:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055842:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055846:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055851:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055855:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055860:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055865:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055869:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055873:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055878:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055882:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055886:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055890:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055894:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055898:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055902:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055908:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055917:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055925:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055933:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055937:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055946:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055981:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055988:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.055995:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056002:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056007:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056013:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056020:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056025:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056030:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056035:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056040:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056044:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056057:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056062:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056068:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.056073:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.057833:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9cfd5cf90200:5816] 1 exiting: rc = 0 00000100:00100000:2.0:1788636469.057989:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9cfd5cf90c00:5815] 0 exiting: rc = 1 00000100:00100000:0.0:1788636469.058532:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058541:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058555:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058618:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058625:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058631:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058637:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058643:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058648:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058654:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058660:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058728:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058735:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058758:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058765:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058770:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058777:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058783:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058789:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058807:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058815:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058822:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058829:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058836:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058841:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058861:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058868:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058884:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058890:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058896:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058901:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058906:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058911:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058917:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058922:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058928:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058937:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058956:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058965:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058971:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058977:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058982:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058990:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.058998:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059006:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059015:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059024:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059033:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059045:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059076:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059089:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059094:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059100:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059107:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059113:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059118:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059123:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059128:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059133:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059139:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059144:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059162:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059173:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.059179:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636469.066432:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9cfd5cf90000:5817] 0 exiting: rc = 1 00000100:00100000:3.0:1788636469.066555:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9cfd5cf91c00:5818] 1 exiting: rc = 0 00000100:00100000:1.0:1788636469.066648:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066655:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066660:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066680:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066685:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066690:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066695:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066700:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066706:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066710:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066715:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066719:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066724:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066728:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066733:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066738:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066742:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066746:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066751:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066772:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066777:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066782:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066786:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066791:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066822:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066830:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066836:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066841:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066845:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066850:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066855:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066859:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066864:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066868:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066873:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066877:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066882:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066886:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066890:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066894:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066899:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066903:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066907:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066911:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066915:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066919:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066923:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066927:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066931:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066935:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066939:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066943:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066947:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066951:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066962:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066966:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066970:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066975:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066979:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066983:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066987:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066991:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.066996:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067000:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636469.067313:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9cfd5cf8bc00:5820] 1 exiting: rc = 0 00000100:00100000:0.0:1788636469.067404:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9cfd5cf91200:5819] 0 exiting: rc = 1 00000100:00100000:1.0:1788636469.067477:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067482:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067487:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067491:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067496:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067501:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067507:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067511:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067516:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067520:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067524:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067528:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067532:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067535:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067539:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067543:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067548:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067552:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067556:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067625:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067630:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067635:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067640:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067644:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067648:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067661:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067720:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067726:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067731:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067735:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067740:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067744:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067748:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067752:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067758:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067762:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067766:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067771:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067775:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067780:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067784:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067788:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067792:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067871:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067882:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067891:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067897:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.067906:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068123:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068131:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068136:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068141:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068145:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068150:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068154:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068158:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068162:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068167:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068171:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068175:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068185:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068190:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068194:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.068199:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636469.069111:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cfd5cf8b200:5821] 0 exiting: rc = 1 00000100:00100000:1.0:1788636469.069247:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cfd5cf8b000:5822] 1 exiting: rc = 0 00000100:00100000:1.0:1788636469.069292:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069298:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069303:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069307:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069312:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069317:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069322:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069327:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069331:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069335:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069340:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069345:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069349:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069353:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069358:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069362:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069366:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069370:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069374:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069378:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069382:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069386:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069391:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069394:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069398:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069402:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069406:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069410:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069414:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069418:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069430:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069434:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069438:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069442:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069447:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069452:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069456:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069460:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069465:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069469:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069473:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069477:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069481:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069485:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069489:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069493:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069497:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069501:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069506:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069510:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069514:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069518:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069522:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069526:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069530:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069534:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069538:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069542:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069546:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069550:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069554:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069569:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069574:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.069586:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636469.070572:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9cfd5d287e00:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1788636469.070679:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9cfd5d286a00:5824] 1 exiting: rc = 0 00000100:00100000:1.0:1788636469.071061:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9cfd5d287600:5825] 2 exiting: rc = 0 00000100:00100000:1.0:1788636469.071120:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071126:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071131:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071137:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071141:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071147:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071164:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071170:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071175:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071180:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071186:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071191:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071196:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071201:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071206:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071210:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071215:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071220:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071225:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071231:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071235:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071241:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071246:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071252:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071258:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071263:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071269:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071273:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071279:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071284:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071302:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071309:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071314:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071319:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071324:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071335:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071340:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071345:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071351:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071355:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071360:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071365:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071370:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071374:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071379:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071383:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071388:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071393:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071397:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071402:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071406:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071413:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071418:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071423:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071440:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071447:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071452:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071457:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071462:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071466:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071471:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071476:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071481:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636469.071494:0:13060:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1788636469.076943:0:13060:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636469.076955:0:13060:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1788636469.076960:0:13060:0:(genops.c:885:class_export_put()) final put ffff9cfd5110a000/MDS_uuid 00000020:00000080:2.0:1788636469.076964:0:13060:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd5110a000/MDS_uuid for MDS 00000020:01000000:2.0:1788636469.076970:0:13060:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1788636469.077090:0:13060:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1788636469.896749:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636469.897220:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636469.897239:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976409088:0@lo:400:kworker.0 00000400:00000100:1.0:1788636469.897303:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875520976409088 offset 0 length 224: 4 00000100:00100000:1.0:1788636469.897377:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976409216:0@lo:400:kworker.0 00000400:00000100:1.0:1788636469.897409:0:3281:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875520976409216 offset 0 length 224: 4 00000100:00100000:3.0:1788636469.898020:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976408960:0@lo:400:kworker.0 00000400:00000100:3.0:1788636469.898046:0:3283:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875520976408960 offset 0 length 224: 4 00000001:00100000:3.0:1788636470.503281:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788636470.503301:0:6685:0:(genops.c:885:class_export_put()) final put ffff9cfd7fcf4800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788636470.503333:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7fcf4800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788636470.503632:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd7fcf4000 for lustre-OST0000 00010000:00010000:1.0:1788636470.912026:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788636471.835588:0:13213:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788636471.847859:0:13213:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788636471.847938:0:13213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636471.847953:0:13213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636471.847960:0:13213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636471.847968:0:13213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636471.847983:0:13213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788636471.847988:0:13213:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788636471.848008:0:13213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788636471.848020:0:13213:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfd7f92f100 x1875520976409088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636485 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636471.848036:0:13213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788636471.848042:0:13213:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788636471.848067:0:13213:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fd0c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788636471.849085:0:11147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636471.849095:0:11147:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636471.849106:0:11147:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe400 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636471.849110:0:11147:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636471.849120:0:11147:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636471.849127:0:11147:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636471.849133:0:11147:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788636471.849135:0:11147:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788636471.849137:0:11147:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788636471.849167:0:11147:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636471.849173:0:11147:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788636471.849212:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976409088:0@lo:400:kworker.0 00010000:00010000:2.0:1788636471.849213:0:11147:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636471.849219:0:11147:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521fe400/0xa6aa59fb12fa7287 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xa6aa59fb12fa728e expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636471.849231:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636471.849233:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636471.849235:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636471.849247:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1875520976409344:0@lo:39:umount.0 00000100:00100000:3.0:1788636471.849389:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976409472:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788636471.849446:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636471.849549:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976409472 00000100:00100000:0.0:1788636471.849563:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976409472 00000100:00100000:0.0:1788636471.849610:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788636471.849617:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3282:x1875520976409472:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788636471.849784:0:5796:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788636471 with bad export cookie 12009510291226914672 00000400:00000100:2.0:1788636471.850334:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875520976409344 offset 0 length 224: 4 00000100:00100000:0.0:1788636471.868060:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612caa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3282:x1875520976409472:12345-0@lo:103:ldlm_bl.0 Request processed in 18435us (18606us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788636471.868072:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788636471.868198:0:3282:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.157@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788636471.868203:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9cfd613a6000 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788636471.868207:0:3282:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.157@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788636471.879117:0:3282:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.157@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788636471.879123:0:3282:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788636471.879133:0:3282:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfd7f92f480 x1875520976408960/t0(0) o400->MGC192.168.203.157@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788636485 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636471.879158:0:3282:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfd76a3a300 x1875520976409472/t0(0) o103->MGC192.168.203.157@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788636487 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788636471.879173:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788636471.879176:0:3282:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788636471.879177:0:3282:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788636471.879181:0:3282:0:(import.c:65:import_set_state_nolock()) ffff9cfd613a6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636471.879186:0:3282:0:(import.c:545:import_select_connection()) MGC192.168.203.157@tcp: connect to NID 0@lo last attempt 113 00000100:00080000:3.0:1788636471.879195:0:3282:0:(import.c:665:import_select_connection()) MGC192.168.203.157@tcp: import ffff9cfd613a6000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636471.879235:0:3282:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612c9f80 x1875520976409600/t0(0) o250->MGC192.168.203.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788636471.879290:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:1196c107-eaca-4490-96fc-d60d67da8edc:3282:1875520976409472:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788636471.879360:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1196c107-eaca-4490-96fc-d60d67da8edc:3279:1875520976409600:0@lo:250:ptlrpcd_00_02.0 00000100:00100000:0.0:1788636471.879396:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:1196c107-eaca-4490-96fc-d60d67da8edc:3283:1875520976408960:0@lo:400:kworker.0 00000400:00000100:2.0:1788636471.879418:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875520976409600 offset 0 length 520: 4 00010000:00010000:3.0:1788636471.937237:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636472.959278:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788636473.528742:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788636473.528875:0:7625:0:(genops.c:885:class_export_put()) final put ffff9cfd613be000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788636473.529015:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd613be000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788636473.529127:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd613b8800 for lustre-OST0001 00010000:00010000:1.0:1788636473.983053:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636475.007231:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636475.007969:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636475.007975:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788636475.008078:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636475.008099:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976409728:0@lo:400:kworker.0 00000400:00000100:2.0:1788636475.008149:0:3282:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875520976409728 offset 0 length 224: 4 00000100:00080000:0.0:1788636476.030984:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788636476.030995:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788636476.031185:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636476.031314:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976409856:0@lo:400:kworker.0 00000400:00000100:3.0:1788636476.031392:0:3280:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875520976409856 offset 0 length 224: 4 00010000:00010000:0.0:1788636477.054974:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636478.079588:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636479.103536:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636480.129176:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636481.150940:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636481.150988:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788636481.150993:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788636481.151050:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636481.151065:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976409984:0@lo:400:kworker.0 00000100:00100000:2.0:1788636481.151097:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636471/real 1788636471] req@ffff9cfd612c9f80 x1875520976409600/t0(0) o250->MGC192.168.203.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788636481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636481.151124:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfd612c9f80 x1875520976409600/t0(0) o250->MGC192.168.203.157@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788636481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636481.151133:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636471/real 1788636471] req@ffff9cfd6f6adc00 x1875520976409344/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788636481 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000400:00000100:3.0:1788636481.157373:0:3280:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875520976409984 offset 0 length 224: 4 00000100:00100000:2.0:1788636481.159543:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfd6f6adc00 x1875520976409344/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788636481 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788636481.159570:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd613a6000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636481.159610:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788636481.159615:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1196c107-eaca-4490-96fc-d60d67da8edc:3279:1875520976409600:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788636481.159621:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fd0c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788636481.159638:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1875520976409344:0@lo:39:umount.0 00000100:00080000:0.0:1788636481.159731:0:13213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788636481.159737:0:13213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00080000:3.0:1788636481.159739:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00100000:0.0:1788636481.159743:0:13213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788636481.159745:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788636481.159749:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfd613a6000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636481.159754:0:38:0:(import.c:545:import_select_connection()) MGC192.168.203.157@tcp: connect to NID 0@lo last attempt 340 00000100:00080000:3.0:1788636481.159759:0:38:0:(import.c:630:import_select_connection()) MGC192.168.203.157@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788636481.159765:0:38:0:(import.c:665:import_select_connection()) MGC192.168.203.157@tcp: import ffff9cfd613a6000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636481.159829:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612c9f80 x1875520976410112/t0(0) o250->MGC192.168.203.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636481.159883:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1196c107-eaca-4490-96fc-d60d67da8edc:3279:1875520976410112:0@lo:250:kworker.0 00000400:00000100:2.0:1788636481.159929:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875520976410112 offset 0 length 520: 4 00010000:00010000:0.0:1788636481.160784:0:13213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636481.160818:0:13213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636481.160826:0:13213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636481.160833:0:13213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636481.161260:0:13213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636481.161271:0:13213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636481.161278:0:13213:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636481.161283:0:13213:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636481.161289:0:13213:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636481.164654:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636481.164668:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636481.164679:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fda00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636481.164684:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636481.164695:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636481.164702:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636481.164708:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788636481.164711:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:1.0:1788636481.164725:0:5798:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cfd613a6000 00010000:00010000:1.0:1788636481.164729:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636481.164736:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd820fda00/0xa6aa59fb12fa7295 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa729c expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636481.164756:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636481.164760:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636481.164822:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd40031600 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636481.164826:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636481.164833:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636481.164840:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636481.164844:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788636481.164847:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:1.0:1788636481.164852:0:5798:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cfd613a6000 00010000:00010000:1.0:1788636481.164855:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636481.164862:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636481.164864:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636481.164865:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636481.165150:0:13213:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788636481.165158:0:13213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd40031600/0xa6aa59fb12fa74be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa74c5 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636481.165200:0:13213:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:0.0:1788636481.165206:0:13213:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:0.0:1788636481.165209:0:13213:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788636481.165241:0:13213:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788636481.165245:0:13213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788636481.165252:0:13213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788636481.165258:0:13213:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788636481.165262:0:13213:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9cfd48dc8000) has no exports 00000020:00080000:0.0:1788636481.165291:0:13213:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9cfd48dc8000) has no exports 00010000:00010000:3.0:1788636481.168594:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788636481.172895:0:13213:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cfd497d7960 - data ffff9cfd6c35f360/ffff9cfd7a39bc00 00000020:01000000:0.0:1788636481.173031:0:13213:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cfd6f7ec060 - data ffff9cfd4fd481b0/ffff9cfd7fcb8000 00100000:10000000:0.0:1788636481.179523:0:13213:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788636481.208947:0:13213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa70a4 00000020:00000080:3.0:1788636481.208957:0:13213:0:(genops.c:885:class_export_put()) final put ffff9cfd7a53a800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788636481.208973:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7a53a800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1788636481.208985:0:13213:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd76a12000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788636481.208988:0:13213:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd76a12000 2 00000020:01000004:3.0:1788636481.208991:0:13213:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cfd76a12000 from lustre-OST0000 00000020:00000080:3.0:1788636481.209014:0:13213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636481.209038:0:13213:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788636481.209042:0:13213:0:(genops.c:885:class_export_put()) final put ffff9cfd7a539000/lustre-OST0000_UUID 00000020:00000080:3.0:1788636481.209044:0:13213:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7a539000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788636481.209056:0:13213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788636481.209105:0:13213:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788636481.209110:0:13213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788636481.209115:0:13213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636481.209120:0:13213:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788636481.209127:0:13213:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9cfd7fd0f000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788636481.209133:0:13213:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9cfd7a543380) has exports, disconnecting them 00000020:00080000:3.0:1788636481.209908:0:13213:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9cfd7fd0f000), last request at 1788636261 00000020:00000080:3.0:1788636481.209918:0:13213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa70ce 00000020:00080000:3.0:1788636481.209931:0:13213:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cfd7fd0f000): rc 0 00000020:00000080:3.0:1788636481.209937:0:13213:0:(genops.c:885:class_export_put()) final put ffff9cfd7fd0f000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788636481.221093:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd7fd0f000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788636481.224828:0:13213:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788636481.224836:0:13213:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788636481.224841:0:13213:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788636481.224848:0:13213:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788636481.225057:0:13213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636481.225067:0:13213:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788636481.225074:0:13213:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd76a12000 1 00000020:00000080:2.0:1788636481.225080:0:13213:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa705e 00000020:00000080:2.0:1788636481.225088:0:13213:0:(genops.c:885:class_export_put()) final put ffff9cfd47fc6800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788636481.225093:0:13213:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788636481.225099:0:13213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788636481.225103:0:13213:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788636481.225106:0:13213:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9cfd48dcb380) has no exports 00000020:00000080:1.0:1788636481.225325:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd7fd0c000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1788636481.225333:0:38:0:(genops.c:885:class_export_put()) final put ffff9cfd75693800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1788636481.225335:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd75693800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1788636481.225345:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1788636481.225402:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd47fc6800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788636481.240702:0:13213:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788636481.240725:0:13213:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788636481.240732:0:13213:0:(genops.c:885:class_export_put()) final put ffff9cfd43ef0000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788636481.240749:0:13213:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd43ef0000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788636481.240755:0:13213:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788636481.240899:0:13213:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cfd76a13000 00000020:02000400:2.0:1788636481.240956:0:13213:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1788636482.177112:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636483.199903:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788636483.938168:0:13366:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788636483.951644:0:13366:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788636483.951713:0:13366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636483.951726:0:13366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636483.951733:0:13366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636483.951740:0:13366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636483.951756:0:13366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788636483.951761:0:13366:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788636483.951791:0:13366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788636483.951824:0:13366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfd7f92d180 x1875520976409216/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636485 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636483.951838:0:13366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfd612c8380 x1875520976409728/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636491 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636483.951850:0:13366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfd6f6af480 x1875520976409856/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636492 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636483.951869:0:13366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfd612ca680 x1875520976409984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636497 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636483.951877:0:13366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:0.0:1788636483.951911:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976409216:0@lo:400:kworker.0 00000100:00100000:0.0:1788636483.951945:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3282:1875520976409728:0@lo:400:kworker.0 00000100:00080000:0.0:1788636483.951978:0:13366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788636483.951999:0:13366:0:(import.c:65:import_set_state_nolock()) ffff9cfd45a2b000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788636483.952034:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636483.952040:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636483.952048:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997da00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636483.952052:0:5798:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636483.952062:0:5798:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636483.952069:0:5798:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636483.952074:0:5798:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788636483.952077:0:5798:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788636483.952079:0:5798:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788636483.952092:0:5798:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cfd613a6000 00010000:00010000:0.0:1788636483.952096:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636483.952103:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997da00/0xa6aa59fb12fa726b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa7272 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636483.952114:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636483.952115:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636483.952119:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636483.952509:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976409984:0@lo:400:kworker.0 00000100:00100000:2.0:1788636483.952518:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976409856:0@lo:400:kworker.0 00000100:00100000:2.0:1788636483.952543:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1875520976410240:0@lo:39:umount.0 00000400:00000100:2.0:1788636483.952596:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875520976410240 offset 0 length 224: 4 00010000:00010000:3.0:1788636484.223369:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636485.247626:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636486.270970:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788636486.278025:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788636486.278035:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788636487.294979:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636488.319229:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636489.343090:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636490.368690:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636491.391049:0:5798:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788636491.391193:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788636491.391199:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 1196c107-eaca-4490-96fc-d60d67da8edc->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1788636492.420492:0:11147:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636493.120204:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636483/real 1788636483] req@ffff9cfd6f6ac380 x1875520976410240/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788636493 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788636493.120235:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfd6f6ac380 x1875520976410240/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788636493 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788636493.120252:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd45a2b000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788636493.120273:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1875520976410240:0@lo:39:umount.0 00000100:00080000:0.0:1788636493.120370:0:13366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788636493.120375:0:13366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788636493.120380:0:13366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788636493.121222:0:13366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636493.121235:0:13366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636493.121243:0:13366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636493.121251:0:13366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636493.121273:0:13366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636493.121281:0:13366:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636493.121288:0:13366:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636493.121294:0:13366:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636493.121319:0:13366:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636493.121341:0:13366:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788636493.121346:0:13366:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788636493.121368:0:13366:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788636493.121372:0:13366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788636493.121376:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788636493.121381:0:13366:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788636493.121385:0:13366:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9cfd76a519c0) has no exports 00000020:00080000:0.0:1788636493.121408:0:13366:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9cfd76a519c0) has no exports 00010000:00010000:2.0:1788636493.121898:0:13061:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636493.121906:0:13061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636493.121913:0:13061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc800 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636493.121917:0:13061:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636493.121924:0:13061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636493.121940:0:13061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636493.121945:0:13061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788636493.121948:0:13061:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:2.0:1788636493.121950:0:13061:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:2.0:1788636493.121964:0:13061:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cfd613a6000 00010000:00010000:2.0:1788636493.121968:0:13061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636493.121975:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd820fc800/0xa6aa59fb12fa7279 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa7280 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636493.121989:0:13061:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636493.121992:0:13061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636493.121998:0:13061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffa00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636493.122001:0:13061:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636493.122007:0:13061:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636493.122012:0:13061:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636493.122017:0:13061:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788636493.122019:0:13061:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788636493.122026:0:13061:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788636493.122033:0:13061:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cfd613a6000 00010000:00010000:2.0:1788636493.122036:0:13061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636493.122042:0:13061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521ffa00/0xa6aa59fb12fa74b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa74b7 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636493.122056:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636493.122058:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636493.122061:0:13061:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636493.122922:0:5799:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788636493.123605:0:13366:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cfd497d7ea0 - data ffff9cfd4fc6daf8/ffff9cfd75dc8400 00000020:01000000:0.0:1788636493.123729:0:13366:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cfd69989960 - data ffff9cfd6e0cb870/ffff9cfc41adf000 00100000:10000000:0.0:1788636493.149393:0:13366:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788636493.178446:0:13366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa716f 00000020:00000080:3.0:1788636493.178456:0:13366:0:(genops.c:885:class_export_put()) final put ffff9cfd75eab800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788636493.178477:0:13366:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd613ba800 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788636493.178481:0:13366:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd613ba800 2 00000020:01000004:3.0:1788636493.178485:0:13366:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cfd613ba800 from lustre-OST0001 00000020:00000080:3.0:1788636493.178531:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636493.178541:0:13366:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788636493.178545:0:13366:0:(genops.c:885:class_export_put()) final put ffff9cfd75eae800/lustre-OST0001_UUID 00000020:00000080:3.0:1788636493.178548:0:13366:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd75eae800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788636493.178556:0:13366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1788636493.178667:0:13366:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 1196c107-eaca-4490-96fc-d60d67da8edc->MGS 00010000:00010000:3.0:1788636493.178683:0:13366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa7088 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636493.178708:0:13366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa7088 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636493.178714:0:13366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788636493.178717:0:13366:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788636493.178720:0:13366:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788636493.178734:0:13366:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cfd613a6000 00010000:00010000:3.0:1788636493.178738:0:13366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd521ff000/0xa6aa59fb12fa7081 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa7088 expref: -99 pid: 6657 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636493.178755:0:13366:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xa6aa59fb12fa72c6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788636493.178761:0:13366:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xa6aa59fb12fa72c6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636493.178767:0:13366:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788636493.178769:0:13366:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788636493.178771:0:13366:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788636493.178781:0:13366:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cfd613a6000 00010000:00010000:3.0:1788636493.178784:0:13366:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd4167da00/0xa6aa59fb12fa72bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xa6aa59fb12fa72c6 expref: -99 pid: 5808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1788636493.178918:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd75eab800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788636493.179141:0:13366:0:(import.c:65:import_set_state_nolock()) ffff9cfd613a6000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788636493.179145:0:13366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788636493.179148:0:13366:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788636493.179149:0:13366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788636493.179154:0:13366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788636493.179165:0:13366:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cfd612c9f80 x1875520976410112/t0(0) o250->MGC192.168.203.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788636496 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788636493.179196:0:13366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788636493.179200:0:13366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 4s for inflight to error out 00000100:00100000:0.0:1788636493.179264:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:1196c107-eaca-4490-96fc-d60d67da8edc:3279:1875520976410112:0@lo:250:kworker.0 10000000:01000000:3.0:1788636493.179539:0:13366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788636493.179547:0:13366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa6f62 00000020:00000080:3.0:1788636493.179552:0:13366:0:(genops.c:885:class_export_put()) final put ffff9cfd6a310000/1196c107-eaca-4490-96fc-d60d67da8edc 00000020:01000000:3.0:1788636493.179569:0:13366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.157@tcp (flags='') 00000020:00000080:3.0:1788636493.179574:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636493.179579:0:13366:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.157@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788636493.179583:0:13366:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9cfd5d20cd40) has no exports 10000000:01000000:1.0:1788636493.179675:0:5808:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1788636493.179748:0:13366:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.157@tcp: client import never connected 00000100:00080000:3.0:1788636493.179751:0:13366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1788636493.179753:0:13366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788636493.179755:0:13366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1788636493.179757:0:13366:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1788636493.179788:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636493.179820:0:13366:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.157@tcp (uuid 1196c107-eaca-4490-96fc-d60d67da8edc) 00000020:01000000:3.0:1788636493.179825:0:13366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1788636493.179829:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636493.179832:0:13366:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788636493.179837:0:13366:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cfd45a2e000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788636493.179842:0:13366:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9cfc42e4cd40) has exports, disconnecting them 00000020:00080000:3.0:1788636493.179845:0:13366:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cfd45a2e000), last request at 1788636279 00000020:00000080:3.0:1788636493.179849:0:13366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa7199 00000020:00080000:3.0:1788636493.179860:0:13366:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cfd45a2e000): rc 0 00000020:00000080:3.0:1788636493.179863:0:13366:0:(genops.c:885:class_export_put()) final put ffff9cfd45a2e000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788636493.180710:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd6a310000/1196c107-eaca-4490-96fc-d60d67da8edc for MGC192.168.203.157@tcp 00000020:00000080:0.0:1788636493.180721:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd613a6000 for MGC192.168.203.157@tcp 00000020:00000080:0.0:1788636493.180727:0:38:0:(genops.c:885:class_export_put()) final put ffff9cfd44d3c000/1196c107-eaca-4490-96fc-d60d67da8edc 00000020:00000080:0.0:1788636493.180729:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd44d3c000/1196c107-eaca-4490-96fc-d60d67da8edc for MGC192.168.203.157@tcp 00000020:01000000:0.0:1788636493.180733:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.157@tcp (1196c107-eaca-4490-96fc-d60d67da8edc) 00000020:00000080:0.0:1788636493.181579:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd45a2e000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788636493.189868:0:13366:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788636493.189876:0:13366:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788636493.189880:0:13366:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788636493.189888:0:13366:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788636493.189970:0:5798:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1788636493.190078:0:11147:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000020:00000080:1.0:1788636493.190284:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9cfd45a2b000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1788636493.278435:0:13061:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:1.0:1788636493.279779:0:5799:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1788636493.280782:0:5793:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9cfd61394000:5793] 0 exiting: rc = 1 00000100:00100000:3.0:1788636493.363984:0:5794:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9cfd587f4c00:5794] 1 exiting: rc = 0 00000100:00100000:0.0:1788636493.364145:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.365483:0:6675:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9cfd7f994600:6675] 3 exiting: rc = 0 00000100:00100000:3.0:1788636493.365590:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9cfd587f4000:5797] 2 exiting: rc = 0 00000100:00100000:0.0:1788636493.367673:0:5796:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9cfd587f5800:5796] 1 exiting: rc = 0 00000100:00100000:0.0:1788636493.368778:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9cfd587f4800:5795] 0 exiting: rc = 1 00000100:00100000:1.0:1788636493.372950:0:13062:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9cfd75bb8800:13062] 4 exiting: rc = 0 00000100:00100000:3.0:1788636493.375166:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375194:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375202:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375208:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375213:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375219:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375224:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375230:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375235:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375241:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375247:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375252:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375257:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375262:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375268:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375274:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375279:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375283:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375287:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375292:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375297:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375301:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375306:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375310:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375315:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375319:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375324:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375329:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375333:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375337:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375341:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375346:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375351:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375355:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375360:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375364:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375375:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375380:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375386:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375391:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375396:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375401:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375406:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375411:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375416:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375421:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375426:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375433:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375438:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375443:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375448:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375453:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375458:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375463:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375468:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375474:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375481:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375486:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375491:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375508:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375515:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375521:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375527:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.375533:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788636493.384365:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788636493.384380:0:13366:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788636493.384392:0:13366:0:(genops.c:885:class_export_put()) final put ffff9cfd45a2c800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788636493.384397:0:13366:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd45a2c800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788636493.384406:0:13366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788636493.384467:0:13366:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd613ba800 1 00000020:00000080:3.0:1788636493.384488:0:13366:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xa6aa59fb12fa713e 00000020:00000080:3.0:1788636493.384495:0:13366:0:(genops.c:885:class_export_put()) final put ffff9cfd613bf000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788636493.384525:0:13366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788636493.384530:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788636493.384535:0:13366:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788636493.384539:0:13366:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9cfd76a50000) has no exports 00000020:00000080:0.0:1788636493.384590:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd613bf000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:0.0:1788636493.442985:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788636493.442999:0:13366:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1788636493.443005:0:13366:0:(genops.c:885:class_export_put()) final put ffff9cfd613bc800/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1788636493.443009:0:13366:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd613bc800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1788636493.443020:0:13366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1788636493.443250:0:13366:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cfd613bb800 00000020:01000000:0.0:1788636493.443272:0:13366:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1788636493.443277:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788636493.443282:0:13366:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788636493.443285:0:13366:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9cfd5d2099c0) has no exports 00000020:00000080:0.0:1788636493.443305:0:13366:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788636493.443310:0:13366:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1788636493.443313:0:13366:0:(genops.c:885:class_export_put()) final put ffff9cfd47fc2800/OSS_uuid 00000020:00000080:0.0:1788636493.443315:0:13366:0:(genops.c:844:class_export_destroy()) destroying export ffff9cfd47fc2800/OSS_uuid for OSS 00000020:01000000:0.0:1788636493.443319:0:13366:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:0.0:1788636493.443341:0:5806:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788636493.443486:0:6963:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9cfd7fe07a00:6963] 3 exiting: rc = 0 00000100:00100000:2.0:1788636493.443534:0:6662:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9cfd75a52000:6662] 2 exiting: rc = 0 00000100:00100000:2.0:1788636493.443596:0:6659:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9cfd75a52600:6659] 0 exiting: rc = 1 00000100:00100000:1.0:1788636493.468109:0:6661:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9cfd698cd200:6661] 1 exiting: rc = 0 00000100:00100000:3.0:1788636493.468611:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468620:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468626:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468645:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468651:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468656:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468662:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468668:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468673:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468678:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468684:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468689:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468694:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468699:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468705:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468710:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468715:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468720:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468725:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468731:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468736:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468742:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468748:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468752:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468758:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468763:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468769:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468775:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468780:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468823:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468829:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468836:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468843:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468851:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468856:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468861:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468867:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468872:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468878:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468883:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468889:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468894:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468899:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468905:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468910:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468915:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468920:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468926:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468932:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468936:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468941:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468946:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468952:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468956:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468961:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468965:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468970:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468975:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468979:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468983:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468988:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468993:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.468998:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.469003:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.470035:0:6663:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9cfd75a52800:6663] 0 exiting: rc = 1 00000100:00100000:1.0:1788636493.470289:0:6664:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9cfd75a53200:6664] 1 exiting: rc = 0 00000100:00100000:3.0:1788636493.471575:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471585:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471590:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471596:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471601:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471606:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471611:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471617:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471678:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471683:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471688:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471694:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471699:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471704:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471708:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471714:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471719:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471725:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471731:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471759:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471765:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471771:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471775:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471780:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471786:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471791:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471811:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471818:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471823:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471828:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471834:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471839:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471844:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471850:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471869:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471875:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471879:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471885:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471890:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471894:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471899:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471903:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471907:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471912:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471916:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471921:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471926:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471931:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471936:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471941:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471945:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471951:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471957:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471962:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471967:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471971:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471976:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471982:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471987:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471992:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.471996:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.472000:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.472005:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.472010:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.476904:0:6665:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9cfd75a52e00:6665] 0 exiting: rc = 1 00000100:00100000:1.0:1788636493.476964:0:6667:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9cfd75a53e00:6667] 2 exiting: rc = 0 00000100:00100000:3.0:1788636493.477438:0:6666:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9cfd75a53800:6666] 1 exiting: rc = 0 00000100:00100000:3.0:1788636493.477508:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477515:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477520:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477540:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477546:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477553:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477559:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477566:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477571:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477577:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477582:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477587:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477592:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477598:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477604:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477610:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477616:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477622:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477628:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477633:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477639:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477645:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477650:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477656:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477660:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477665:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477671:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477677:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477682:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477705:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477712:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477717:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477723:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477729:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477735:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477741:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477747:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477753:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477766:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477772:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477777:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477784:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477789:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477812:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477822:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477833:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477840:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477845:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477851:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477856:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477861:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477866:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477871:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477876:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477881:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477886:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477907:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477914:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477920:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477925:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477931:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477936:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477941:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.477946:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788636493.486005:0:6668:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cfd75a53600:6668] 0 exiting: rc = 1 00000100:00100000:1.0:1788636493.486063:0:6669:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cfd75a52400:6669] 1 exiting: rc = 0 00000100:00100000:3.0:1788636493.486848:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486857:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486863:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486870:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486876:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486882:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486887:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486892:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486897:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486918:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486922:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486928:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486933:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486938:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486943:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486978:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486985:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486990:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.486995:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487001:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487006:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487011:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487016:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487022:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487028:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487033:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487038:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487043:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487049:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487054:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487058:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487064:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487069:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487075:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487080:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487085:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487090:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487095:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487100:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487106:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487111:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487116:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487122:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487126:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487142:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487147:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487152:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487158:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487163:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487168:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487173:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487445:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487453:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487458:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487463:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487468:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487473:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487477:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487481:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487486:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487491:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487495:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487511:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788636493.487516:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788636493.490888:0:6671:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9cfd81525000:6671] 1 exiting: rc = 0 00000100:00100000:0.0:1788636493.491265:0:6670:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9cfd81525200:6670] 0 exiting: rc = 1 00000100:00100000:2.0:1788636493.491320:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491343:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491351:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491356:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491362:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491368:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491375:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491379:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491384:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491390:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491406:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491412:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491417:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491438:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491444:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491450:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491455:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491460:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491466:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491491:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491509:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491516:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491525:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491530:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491536:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491561:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491568:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491574:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491580:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491586:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491591:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491597:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491602:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491609:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491616:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491622:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491629:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491650:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491657:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491666:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491672:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491679:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491686:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491693:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491699:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491705:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491712:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491719:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491726:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491748:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491755:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491760:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491766:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491771:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491784:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491789:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491812:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491819:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491823:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491828:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491834:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491841:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491849:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788636493.491858:0:13366:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1788636493.510476:0:13366:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788636511.462607:0:13985:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788636519.877411:0:14446:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788636519.877416:0:14446:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1788636519.877520:0:14446:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cfd610d7000 00000020:01000004:1.0:1788636519.877536:0:14446:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788636519.877543:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788636519.877557:0:14446:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9cfd76a50000) 00000020:00000080:1.0:1788636519.877609:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788636519.916984:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788636519.918778:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1788636519.919138:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 423: rc = 0 00100000:10000000:0.0:1788636519.919226:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 423: rc = 0 00100000:10000000:0.0:1788636519.919302:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 423: rc = 0 00100000:10000000:0.0:1788636519.919556:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788636519.919624:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 423: rc = 0 00100000:10000000:0.0:1788636519.919716:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 423: rc = 0 00100000:10000000:0.0:1788636519.919840:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 423: rc = 0 00100000:10000000:0.0:1788636519.920089:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 425: rc = 0 00100000:10000000:0.0:1788636519.922021:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 561: rc = 0 00100000:10000000:0.0:1788636519.922122:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 561: rc = 0 00100000:10000000:0.0:1788636519.922613:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 565: rc = 0 00100000:10000000:0.0:1788636519.925074:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 565: rc = 0 00100000:10000000:0.0:1788636519.925571:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 565: rc = 0 00100000:10000000:0.0:1788636519.925983:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 565: rc = 0 00100000:10000000:0.0:1788636519.926226:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 565: rc = 0 00100000:10000000:0.0:1788636519.926571:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 565: rc = 0 00100000:10000000:0.0:1788636519.926933:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 565: rc = 0 00100000:10000000:0.0:1788636519.927174:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 565: rc = 0 00100000:10000000:0.0:1788636519.927434:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 565: rc = 0 00100000:10000000:2.0:1788636519.928139:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 565: rc = 0 00100000:10000000:2.0:1788636519.928409:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 565: rc = 0 00100000:10000000:2.0:1788636519.935211:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 565: rc = 0 00100000:10000000:2.0:1788636519.936073:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 652: rc = 0 00100000:10000000:2.0:1788636519.936329:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 652: rc = 0 00100000:10000000:2.0:1788636519.936579:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 652: rc = 0 00100000:10000000:2.0:1788636519.936899:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 652: rc = 0 00100000:10000000:2.0:1788636519.937142:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 652: rc = 0 00100000:10000000:2.0:1788636519.937394:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 652: rc = 0 00100000:10000000:2.0:1788636519.937651:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 652: rc = 0 00100000:10000000:2.0:1788636519.937941:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 652: rc = 0 00100000:10000000:2.0:1788636519.938185:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 652: rc = 0 00100000:10000000:2.0:1788636519.944529:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 652: rc = 0 00100000:10000000:2.0:1788636519.945035:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 652: rc = 0 00100000:10000000:2.0:1788636519.945573:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 652: rc = 0 00100000:10000000:2.0:1788636519.946083:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 652: rc = 0 00100000:10000000:2.0:1788636519.946584:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 652: rc = 0 00100000:10000000:2.0:1788636519.947349:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 652: rc = 0 00100000:10000000:2.0:1788636519.947705:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 652: rc = 0 00100000:10000000:2.0:1788636519.948475:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 652: rc = 0 00100000:10000000:2.0:1788636519.948838:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 652: rc = 0 00100000:10000000:2.0:1788636519.949158:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 652: rc = 0 00100000:10000000:2.0:1788636519.949753:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 652: rc = 0 00100000:10000000:2.0:1788636519.950629:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 652: rc = 0 00100000:10000000:2.0:1788636519.951237:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 652: rc = 0 00100000:10000000:2.0:1788636519.951618:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 652: rc = 0 00100000:10000000:2.0:1788636519.952154:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 652: rc = 0 00100000:10000000:2.0:1788636519.952620:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 652: rc = 0 00100000:10000000:2.0:1788636519.953066:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 652: rc = 0 00100000:10000000:2.0:1788636519.953554:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 652: rc = 0 00100000:10000000:2.0:1788636519.954641:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 652: rc = 0 00100000:10000000:2.0:1788636519.955516:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 652: rc = 0 00100000:10000000:2.0:1788636519.956000:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 652: rc = 0 00100000:10000000:2.0:1788636519.956349:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 652: rc = 0 00100000:10000000:2.0:1788636519.956667:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 652: rc = 0 00100000:10000000:2.0:1788636519.957526:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 183: rc = 0 00100000:10000000:2.0:1788636519.958358:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788636519.958590:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 178: rc = 0 00100000:10000000:2.0:1788636519.959022:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788636519.959097:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 178: rc = 0 00100000:10000000:3.0:1788636519.961100:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788636519.961482:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 178: rc = 0 00100000:10000000:3.0:1788636519.962083:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788636519.962227:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 562: rc = 0 00100000:10000000:3.0:1788636519.962561:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788636519.962634:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 562: rc = 0 00100000:10000000:3.0:1788636519.963309:0:14446:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788636519.963463:0:14446:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 562: rc = 0 00000020:00000080:3.0:1788636519.963735:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788636519.963743:0:14446:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788636519.963753:0:14446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa8263 00000020:01000004:3.0:1788636519.963762:0:14446:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788636519.963775:0:14446:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788636519.963780:0:14446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cfd610d7000 from MGS 00000020:01000004:3.0:1788636519.963784:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788636519.963815:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cfd613419c0) 00000020:00000080:3.0:1788636519.963827:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788636519.963955:0:14446:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd610d7000 from MGS, refs=2 00080000:01000000:3.0:1788636519.963961:0:14446:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788636519.963968:0:14446:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa8271 00000100:00100000:3.0:1788636519.964064:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788636519.964270:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788636519.964277:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788636519.964998:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788636519.965006:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788636519.966003:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636519.966221:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788636519.966227:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788636519.966949:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788636519.966956:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788636519.967326:0:14446:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788636519.967331:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788636519.967949:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636519.967952:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636519.967954:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636519.968278:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636519.968281:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636519.968283:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636519.968742:0:14446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788636519.970212:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788636519.988345:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1788636519.988363:0:14446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788636519.988367:0:14446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788636519.990924:0:14455:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788636519.991133:0:14446:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788636519.991231:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788636519.991903:0:14446:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788636519.992538:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636519.992904:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788636519.992911:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788636519.999483:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1788636519.999496:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1788636520.001873:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1788636520.001890:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1788636520.002580:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1788636520.002603:0:14446:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.157@tcp' 00000020:01000004:0.0:1788636520.002605:0:14446:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1788636520.002637:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.157@tcp (typ=mgc) 00000020:00000080:0.0:1788636520.002650:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.157@tcp (ffff9cfc42e4b380) 00000020:00000080:0.0:1788636520.002664:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1788636520.002744:0:14446:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd60e9f000@MGC192.168.203.157@tcp: add connection 192.168.203.157@tcp at head 00010000:00010000:0.0:1788636520.002924:0:14446:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.157@tcp-0 is initialized 00000040:01000000:0.0:1788636520.002930:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.157@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788636520.003340:0:14460:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1788636520.007928:0:14461:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788636520.007987:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.157@tcp (uuid c8fa81e7-22d5-4023-a9dc-119f1fc21189) 00000020:00000080:0.0:1788636520.008011:0:14446:0:(genops.c:1385:class_connect()) connect: client c8fa81e7-22d5-4023-a9dc-119f1fc21189, cookie 0xa6aa59fb12fa827f 00000100:00080000:0.0:1788636520.008024:0:14446:0:(import.c:545:import_select_connection()) MGC192.168.203.157@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788636520.008030:0:14446:0:(import.c:665:import_select_connection()) MGC192.168.203.157@tcp: import ffff9cfd60e9f000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:0.0:1788636520.008063:0:14446:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd6f6af100 x1875520976410368/t0(0) o250->MGC192.168.203.157@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636520.008091:0:14446:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import c8fa81e7-22d5-4023-a9dc-119f1fc21189->MGS 00000020:01000004:0.0:1788636520.008111:0:14446:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788636520.008116:0:14446:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788636520.008130:0:14446:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9cfc42e48000) 00000020:00000080:0.0:1788636520.008141:0:14446:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788636520.008294:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3279:1875520976410368:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788636520.008369:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.008432:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976410368 00000100:00100000:2.0:1788636520.008460:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976410368 00000100:00100000:2.0:1788636520.008497:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636520.008504:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd766f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:3279:x1875520976410368:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788636520.008524:0:14458:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c8fa81e7-22d5-4023-a9dc-119f1fc21189@0@lo t0 exp 0000000000000000 cur 389 last 0 00000020:00000080:2.0:1788636520.008550:0:14458:0:(genops.c:1385:class_connect()) connect: client c8fa81e7-22d5-4023-a9dc-119f1fc21189, cookie 0xa6aa59fb12fa828d 00000100:00080000:2.0:1788636520.008681:0:14458:0:(import.c:65:import_set_state_nolock()) ffff9cfc41ffc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636520.008729:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd766f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+5:3279:x1875520976410368:12345-0@lo:250:mount.lustre.0 Request processed in 224us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636520.008737:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636520.008776:0:3279:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.157@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788636520.008783:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.203.157@tcp: connect to target with instance 0 00000100:00080000:2.0:1788636520.008790:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.203.157@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788636520.008813:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788636520.008816:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd60e9f000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788636520.008818:0:3279:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788636520.008821:0:3279:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788636520.008825:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3279:1875520976410368:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1788636520.024299:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636520.024954:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788636520.024961:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788636520.032631:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788636520.032644:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788636520.033604:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788636520.033613:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788636520.034601:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636520.034764:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788636520.034770:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1788636520.035615:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1788636520.035623:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788636520.078268:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636520.078615:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788636520.078623:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788636520.080178:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788636520.080188:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788636520.087791:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636520.088008:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788636520.088014:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788636520.090884:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788636520.090895:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788636520.093138:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636520.093334:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788636520.093340:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788636520.093957:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788636520.093964:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788636520.094575:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636520.094764:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788636520.094769:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788636520.099917:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788636520.099947:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788636520.127604:0:14446:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636520.127906:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788636520.127913:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788636520.129475:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788636520.129486:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788636520.130379:0:14446:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788636520.130387:0:14446:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788636520.131234:0:14446:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788636520.131256:0:14446:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788636520.131262:0:14446:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.157@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788636520.131416:0:14446:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.157@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788636520.131460:0:14446:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.157@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788636520.131465:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788636520.131466:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788636520.131468:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636520.131469:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636520.131470:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636520.131476:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636520.131477:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788636520.131478:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788636520.131480:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636520.131481:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788636520.131483:0:14446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788636520.131485:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788636520.131486:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788636520.131487:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636520.131488:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636520.131489:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636520.131490:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636520.131491:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788636520.131492:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788636520.131492:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636520.131493:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788636520.131520:0:14446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788636520.131539:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976410496:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788636520.131606:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636520.131656:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.131780:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976410496 00000100:00100000:0.0:1788636520.131787:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976410496 00000100:00100000:0.0:1788636520.131857:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636520.131866:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd766f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+5:14446:x1875520976410496:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788636520.131911:0:14459:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788636520.131915:0:14459:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788636520.131917:0:14459:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788636520.133077:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788636520.133431:0:14459:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788636520.134858:0:14481:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788636520.134865:0:14481:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788636520.134875:0:14481:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788636520.134911:0:14481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1788636520.135264:0:14459:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788636520.135273:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1788636520.141864:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd766f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+5:14446:x1875520976410496:12345-0@lo:253:mount.lustre.0 Request processed in 9991us (10249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636520.141878:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636520.144983:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976410496:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788636520.145002:0:14446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788636520.145005:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788636520.145007:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788636520.145008:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636520.145010:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636520.145011:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636520.145013:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636520.145014:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788636520.145016:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788636520.145018:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636520.145019:0:14446:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788636520.145043:0:14446:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cfd610d7000 from lustre-MDT0000 10000000:01000000:1.0:1788636520.145073:0:14446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788636520.145076:0:14446:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788636520.145080:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cfc42e4b380 10000000:01000000:1.0:1788636520.145083:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636520.145102:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cfc42e4b380 from 1 10000000:01000000:1.0:1788636520.145105:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788636520.145149:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.145161:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.145176:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636520.145194:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976410624:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636520.145249:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636520.145287:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636520.145329:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976410624 00000100:00100000:2.0:1788636520.145336:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976410624 00000100:00100000:2.0:1788636520.145384:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636520.145394:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd766f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+5:14446:x1875520976410624:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636520.145405:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636520.145420:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd6f4eb200/0xa6aa59fb12fa829b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa8294 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.145600:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd6f4eb200/0xa6aa59fb12fa829b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8294 expref: 6 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.145624:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd6f4eb200/0xa6aa59fb12fa829b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8294 expref: 6 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.145633:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb200, rc 0) 00000100:00100000:2.0:1788636520.145681:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd766f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+6:14446:x1875520976410624:12345-0@lo:101:mount.lustre.0 Request processed in 289us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636520.145689:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788636520.145833:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976410624:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636520.145845:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.145854:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636520.145899:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976410752:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636520.145923:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636520.145948:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.146022:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976410752 00000100:00100000:0.0:1788636520.146033:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976410752 00000100:00100000:0.0:1788636520.146091:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636520.146099:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+6:14446:x1875520976410752:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636520.146328:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+6:14446:x1875520976410752:12345-0@lo:501:mount.lustre.0 Request processed in 230us (403us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636520.146336:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636520.146522:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976410752:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788636520.146545:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788636520.146567:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.146587:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636520.146594:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cfd610d7000 10000000:01000000:1.0:1788636520.146598:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788636520.146601:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cfd610d7000 10000000:01000000:1.0:1788636520.146603:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788636520.146606:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cfd610d7000 from 1 10000000:01000000:1.0:1788636520.146608:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788636520.146625:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b600/0xa6aa59fb12fa82a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.146632:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b600/0xa6aa59fb12fa82a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.146641:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b600/0xa6aa59fb12fa82a2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636520.146652:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976410880:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636520.146676:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636520.153604:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976410880 00000100:00100000:3.0:1788636520.153619:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976410880 00000100:00100000:3.0:1788636520.153682:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636520.153692:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+6:14446:x1875520976410880:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636520.153710:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636520.153733:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa82a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa82a2 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636520.153760:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa82a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa82a2 expref: 7 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636520.153770:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997ca00/0xa6aa59fb12fa82a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa82a2 expref: 7 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636520.153779:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997ca00, rc 0) 00000100:00100000:3.0:1788636520.153869:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+7:14446:x1875520976410880:12345-0@lo:101:mount.lustre.0 Request processed in 179us (7191us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636520.153875:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636520.155850:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4780 going to sleep for 11 seconds 00000100:00100000:2.0:1788636520.155887:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976410880:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636520.155915:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b600/0xa6aa59fb12fa82a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa82a9 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.155927:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b600/0xa6aa59fb12fa82a2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa82a9 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636520.155955:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788636520.155971:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b600/0xa6aa59fb12fa82a2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa82a9 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.155979:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b600/0xa6aa59fb12fa82a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa82a9 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636520.155987:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788636520.155994:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636520.156000:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cfd610d7000 10000000:01000000:2.0:1788636520.156002:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788636520.156006:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788636520.156021:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788636520.156062:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea600/0xa6aa59fb12fa82b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.156070:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea600/0xa6aa59fb12fa82b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.156078:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea600/0xa6aa59fb12fa82b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636520.156101:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976411008:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636520.156158:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.156183:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd457f2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636520.156371:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976411008 00000100:00100000:3.0:1788636520.156377:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976411008 00000100:00100000:3.0:1788636520.156432:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636520.156548:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+7:14446:x1875520976411008:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636520.156561:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636520.156579:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa82b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa82b0 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636520.156598:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa82b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa82b0 expref: 8 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636520.156615:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c800/0xa6aa59fb12fa82b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa82b0 expref: 8 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636520.156623:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c800, rc 0) 00000100:00100000:3.0:1788636520.156671:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+8:14446:x1875520976411008:12345-0@lo:101:mount.lustre.0 Request processed in 231us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636520.156677:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636520.156824:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976411008:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636520.156837:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea600/0xa6aa59fb12fa82b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa82b7 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.156845:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea600/0xa6aa59fb12fa82b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa82b7 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636520.156901:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976411136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636520.156930:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.157042:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd457f2900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.157095:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976411136 00000100:00100000:0.0:1788636520.157099:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976411136 00000100:00100000:0.0:1788636520.157132:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636520.157139:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+8:14446:x1875520976411136:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636520.157660:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+9:14446:x1875520976411136:12345-0@lo:501:mount.lustre.0 Request processed in 520us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636520.157668:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636520.157819:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976411136:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636520.157851:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976411264:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636520.157887:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.157904:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd457f2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636520.158023:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976411264 00000100:00100000:3.0:1788636520.158028:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976411264 00000100:00100000:3.0:1788636520.158062:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636520.158069:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+9:14446:x1875520976411264:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636520.158370:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+9:14446:x1875520976411264:12345-0@lo:503:mount.lustre.0 Request processed in 301us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636520.158378:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788636520.158605:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976411264:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636520.159400:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14482:1875520976411392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636520.159577:0:14482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636520.159615:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7facc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636520.159681:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976411392 00000100:00100000:2.0:1788636520.159688:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976411392 00000100:00100000:2.0:1788636520.159729:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788636520.159737:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+9:14482:x1875520976411392:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636520.160205:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+9:14482:x1875520976411392:12345-0@lo:502:llog_process_th.0 Request processed in 467us (626us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636520.160214:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636520.160394:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14482:1875520976411392:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788636520.160434:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636520.160556:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636520.160559:0:14482:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788636520.160565:0:14482:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788636520.160569:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636520.160583:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cfc42e499c0) 00000020:00000080:0.0:1788636520.160600:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788636520.160605:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788636520.160665:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788636520.160671:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa82c5 00000020:00000080:0.0:1788636520.160900:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788636520.160911:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788636520.160914:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636520.160916:0:14482:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788636520.160919:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788636520.160922:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788636520.160923:0:14482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788636520.160926:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788636520.161001:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cfc42e4cd40) 00000020:00000080:0.0:1788636520.161013:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788636520.161018:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788636520.161020:0:14482:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788636520.161022:0:14482:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788636520.161028:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788636520.161067:0:14482:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd610d7000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788636520.161089:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cfd50748000) 00000020:00000080:0.0:1788636520.161097:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788636520.161149:0:14482:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788636520.161154:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa82da 00000020:00000080:0.0:1788636520.161242:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788636520.161247:0:14482:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788636520.161251:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xa6aa59fb12fa82e1 00080000:01000000:0.0:1788636520.161255:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788636520.161258:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa82e8 00010000:00010000:3.0:1788636520.270612:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788636520.271731:0:14482:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1788636520.271963:0:14482:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788636520.272449:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9cfd61344d40) 00000020:00000080:3.0:1788636520.272468:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788636520.272527:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788636520.272533:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa82f6 00000020:00000080:3.0:1788636520.277361:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788636520.286346:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xa6aa59fb12fa82fd 00000020:00000080:1.0:1788636520.289218:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788636520.289231:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636520.289253:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.289255:0:14482:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788636520.289266:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788636520.289268:0:14482:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1788636520.289270:0:14482:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636520.289271:0:14482:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636520.289273:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788636520.289284:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.289286:0:14482:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788636520.289290:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636520.289295:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.289296:0:14482:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788636520.289301:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788636520.289356:0:14482:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788636520.289374:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636520.289377:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.289378:0:14482:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1788636520.289381:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636520.289384:0:14482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788636520.289387:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.289388:0:14482:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1788636520.289391:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788636520.289396:0:14482:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.157@tcp to nid 0x20000c0a8cb9d (192.168.203.157@tcp) 00000020:01000000:1.0:1788636520.289421:0:14482:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788636520.289425:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636520.289440:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cfd76a519c0) 00000020:00000080:1.0:1788636520.289455:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1788636520.289459:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788636520.289514:0:14482:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788636520.289520:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788636520.289527:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa830b 00010000:00080000:1.0:1788636520.289559:0:14482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd60e86000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.157@tcp at head 00010000:00010000:1.0:1788636520.289783:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1788636520.290247:0:14482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788636520.290295:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788636520.291678:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636520.291745:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1788636520.293053:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1788636520.294479:0:14486:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788636520.294486:0:14486:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788636520.304443:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788636520.304456:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788636520.304496:0:14482:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788636520.304512:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa8312 00000100:00080000:3.0:1788636520.304521:0:14482:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636520.304527:0:14482:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cfd60e86000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636520.304561:0:14482:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612c9c00 x1875520976411520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636520.304633:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976411520:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788636520.304682:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875520976411520 offset 0 length 520: 4 00000100:00080000:3.0:1788636520.304736:0:14482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788636520.304825:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636520.304829:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636520.304831:0:14482:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788636520.304834:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788636520.304836:0:14482:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788636520.304838:0:14482:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788636520.304840:0:14482:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788636520.304841:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788636520.304843:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636520.304844:0:14482:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788636520.304846:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788636520.304850:0:14482:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788636520.304853:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636520.304854:0:14482:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788636520.304857:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788636520.304860:0:14482:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.157@tcp to nid 0x20000c0a8cb9d (192.168.203.157@tcp) 00000020:01000000:3.0:1788636520.304877:0:14482:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788636520.304879:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788636520.304888:0:14482:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cfd61343380) 00000020:00000080:3.0:1788636520.304899:0:14482:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788636520.304902:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788636520.304951:0:14482:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788636520.304957:0:14482:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788636520.304962:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xa6aa59fb12fa8320 00010000:00080000:3.0:1788636520.304988:0:14482:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd74e13800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.157@tcp at head 00010000:00010000:3.0:1788636520.305166:0:14482:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788636520.305337:0:14482:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788636520.305357:0:14482:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788636520.305845:0:14482:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636520.305901:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788636520.305954:0:14482:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788636520.310653:0:14488:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788636520.310671:0:14488:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788636520.311411:0:14482:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788636520.311423:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788636520.311453:0:14482:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788636520.311475:0:14482:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa8327 00000100:00080000:1.0:1788636520.311485:0:14482:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788636520.311491:0:14482:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cfd74e13800 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:1.0:1788636520.311525:0:14482:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd7f92f800 x1875520976411648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788636520.313372:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976411648:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788636520.313435:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875520976411648 offset 0 length 520: 4 00000100:00080000:1.0:1788636520.316093:0:14482:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788636520.316188:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636520.316196:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.316198:0:14482:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788636520.316202:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636520.316207:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.316208:0:14482:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636520.316212:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636520.316213:0:14482:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788636520.316216:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636520.316218:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.316219:0:14482:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788636520.316222:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636520.316224:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.316225:0:14482:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788636520.316229:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788636520.316275:0:14482:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14482:1875520976411776:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636520.316363:0:14482:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636520.316394:0:14482:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f9a4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.316850:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976411776 00000100:00100000:0.0:1788636520.316857:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976411776 00000100:00100000:0.0:1788636520.316900:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636520.316910:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+9:14482:x1875520976411776:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636520.317148:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+9:14482:x1875520976411776:12345-0@lo:502:llog_process_th.0 Request processed in 239us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636520.317156:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788636520.317358:0:14482:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92ea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14482:1875520976411776:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636520.317390:0:14482:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636520.317400:0:14482:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.317402:0:14482:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788636520.317406:0:14482:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788636520.317555:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788636520.317572:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788636520.317593:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea600/0xa6aa59fb12fa82b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa82b7 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.317604:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea600/0xa6aa59fb12fa82b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa82b7 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636520.317611:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cfd610d7000 from 1 10000000:01000000:2.0:1788636520.317613:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788636520.317639:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.317647:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.317666:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636520.317685:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976411904:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636520.317718:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.317751:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eeb180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.318274:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976411904 00000100:00100000:0.0:1788636520.318281:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976411904 00000100:00100000:0.0:1788636520.318336:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636520.318345:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+9:14446:x1875520976411904:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636520.318356:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636520.318372:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa832e expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.318395:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 10 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.318407:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 10 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.318415:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c200, rc 0) 00000100:00100000:0.0:1788636520.318453:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+10:14446:x1875520976411904:12345-0@lo:101:mount.lustre.0 Request processed in 110us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636520.318460:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636520.318536:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976411904:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636520.318550:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.318560:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636520.319127:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412032:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788636520.319168:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.319190:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eeb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636520.319209:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976412032 00000100:00100000:2.0:1788636520.319213:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976412032 00000100:00100000:2.0:1788636520.319241:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636520.319248:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+10:14446:x1875520976412032:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788636520.319262:0:14459:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788636520.319268:0:14459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788636520.319345:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+10:14446:x1875520976412032:12345-0@lo:256:mount.lustre.0 Request processed in 97us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636520.319352:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788636520.319384:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412032:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788636520.320011:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788636520.320020:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.320029:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636520.320036:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd610d7000 from 1 10000000:01000000:2.0:1788636520.320039:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636520.320060:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.320067:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.320074:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636520.320087:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412160:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636520.320120:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.320140:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eeb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636520.320158:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976412160 00000100:00100000:2.0:1788636520.320162:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976412160 00000100:00100000:2.0:1788636520.320184:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636520.320191:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+10:14446:x1875520976412160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636520.320199:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636520.320209:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa833c expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.320240:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.320250:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.320258:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ebe00, rc 0) 00000100:00100000:2.0:1788636520.320287:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14446:x1875520976412160:12345-0@lo:101:mount.lustre.0 Request processed in 97us (166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636520.320293:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636520.320339:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412160:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636520.320351:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.320358:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636520.320401:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636520.320425:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.320439:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eeb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636520.320450:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976412288 00000100:00100000:2.0:1788636520.320454:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976412288 00000100:00100000:2.0:1788636520.320469:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636520.320475:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14446:x1875520976412288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636520.320840:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14446:x1875520976412288:12345-0@lo:501:mount.lustre.0 Request processed in 364us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636520.320854:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636520.320887:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636520.320913:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636520.320949:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.320964:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eeb180 going to sleep for 11 seconds 00000100:00100000:2.0:1788636520.320978:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976412416 00000100:00100000:2.0:1788636520.320982:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976412416 00000100:00100000:2.0:1788636520.320999:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636520.321005:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14446:x1875520976412416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636520.321131:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14446:x1875520976412416:12345-0@lo:503:mount.lustre.0 Request processed in 125us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636520.321138:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636520.321174:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636520.321393:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14490:1875520976412544:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636520.321428:0:14490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.321446:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976412544 00000100:00100000:2.0:1788636520.321450:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976412544 00000100:00100000:2.0:1788636520.321472:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636520.321478:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14490:x1875520976412544:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788636520.321629:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14490:x1875520976412544:12345-0@lo:502:llog_process_th.0 Request processed in 150us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636520.321636:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636520.321665:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd47eeb540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636520.321678:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14490:1875520976412544:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788636520.321704:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636520.321712:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636520.321715:0:14490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788636520.321722:0:14490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd610d7000 00000020:00000080:2.0:1788636520.321724:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636520.321731:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788636520.321734:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636520.321735:0:14490:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788636520.321738:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788636520.321740:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788636520.321741:0:14490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788636520.321744:0:14490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd610d7000 00000020:00000080:2.0:1788636520.321746:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788636520.321812:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636520.329525:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636520.329534:0:14490:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788636520.329545:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636520.329551:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636520.329553:0:14490:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636520.329558:0:14490:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cfd610d7000 00000020:00000080:3.0:1788636520.329560:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788636520.329650:0:14490:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14490:1875520976412672:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636520.329732:0:14490:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636520.329788:0:14490:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611583c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.329923:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976412672 00000100:00100000:0.0:1788636520.329932:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976412672 00000100:00100000:0.0:1788636520.329974:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636520.329984:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14490:x1875520976412672:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788636520.330213:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14490:x1875520976412672:12345-0@lo:502:llog_process_th.0 Request processed in 230us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636520.330221:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788636520.330303:0:14490:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14490:1875520976412672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788636520.330340:0:14490:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636520.330346:0:14490:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636520.330348:0:14490:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788636520.330353:0:14490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1788636520.330500:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788636520.330517:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636520.330538:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.330549:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636520.330603:0:14446:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788636520.330606:0:14446:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cfd610d7000 10000000:01000000:0.0:1788636520.330609:0:14446:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cfd610d7000 10000000:01000000:0.0:1788636520.330613:0:14446:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788636520.330619:0:14446:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd610d7000 from 1 10000000:01000000:0.0:1788636520.330621:0:14446:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788636520.330647:0:14446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8191ce00/0xa6aa59fb12fa834a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.330656:0:14446:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8191ce00/0xa6aa59fb12fa834a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.330665:0:14446:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8191ce00/0xa6aa59fb12fa834a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636520.330682:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788636520.330713:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636520.330738:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d27c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.330757:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976412800 00000100:00100000:0.0:1788636520.330761:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976412800 00000100:00100000:0.0:1788636520.330786:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636520.330793:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14446:x1875520976412800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636520.330828:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636520.330841:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191d800/0xa6aa59fb12fa8351 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa834a expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.330861:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191d800/0xa6aa59fb12fa8351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa834a expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.330884:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191d800/0xa6aa59fb12fa8351 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa834a expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.330895:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d800, rc 0) 00000100:00100000:0.0:1788636520.330927:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14446:x1875520976412800:12345-0@lo:101:mount.lustre.0 Request processed in 134us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636520.330934:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636520.330966:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636520.330978:0:14446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8191ce00/0xa6aa59fb12fa834a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8351 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.330987:0:14446:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8191ce00/0xa6aa59fb12fa834a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8351 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636520.331029:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636520.331054:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636520.331067:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d27c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.331079:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976412928 00000100:00100000:0.0:1788636520.331082:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976412928 00000100:00100000:0.0:1788636520.331099:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636520.331104:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14446:x1875520976412928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636520.331310:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14446:x1875520976412928:12345-0@lo:501:mount.lustre.0 Request processed in 204us (254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636520.331330:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636520.331364:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976412928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636520.331399:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976413056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636520.331435:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636520.331449:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d27c540 going to sleep for 11 seconds 00000100:00100000:0.0:1788636520.331463:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976413056 00000100:00100000:0.0:1788636520.331466:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976413056 00000100:00100000:0.0:1788636520.331483:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636520.331489:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14446:x1875520976413056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636520.331619:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14446:x1875520976413056:12345-0@lo:503:mount.lustre.0 Request processed in 129us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636520.331626:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788636520.331665:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976413056:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636520.356715:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14491:1875520976413184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636520.356831:0:14491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636520.356874:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636520.356978:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976413184 00000100:00100000:1.0:1788636520.356985:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976413184 00000100:00100000:1.0:1788636520.357029:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788636520.357038:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14491:x1875520976413184:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788636520.357264:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14491:x1875520976413184:12345-0@lo:502:llog_process_th.0 Request processed in 226us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636520.357271:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788636520.357355:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14491:1875520976413184:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788636520.357415:0:14491:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788636520.357428:0:14491:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9cfd61340000) 00000020:00000080:3.0:1788636520.357445:0:14491:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1788636520.357505:0:14491:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd610d7000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788636520.357509:0:14491:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd610d7000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788636520.357511:0:14491:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd610d7000 4 00010000:00080000:3.0:1788636520.357538:0:14491:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd76a37000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.157@tcp at head 00010000:00010000:3.0:1788636520.361465:0:14491:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1788636520.361676:0:14491:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788636520.361721:0:14491:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788636520.361734:0:14491:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xa6aa59fb12fa835f 00000100:00080000:3.0:1788636520.361744:0:14491:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636520.361750:0:14491:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cfd76a37000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636520.361785:0:14491:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612caa00 x1875520976413312/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636520.364394:0:14491:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788636520.365338:0:14491:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14491:1875520976413440:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636520.365426:0:14491:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636520.365466:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976413440 00000100:00100000:3.0:1788636520.365473:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976413440 00000100:00100000:3.0:1788636520.365519:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636520.365528:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14491:x1875520976413440:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788636520.365942:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14491:x1875520976413440:12345-0@lo:502:llog_process_th.0 Request processed in 414us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636520.365952:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636520.365997:0:14491:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636520.366018:0:14491:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14491:1875520976413440:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788636520.366046:0:14491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788636520.366165:0:14446:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788636520.366185:0:14446:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788636520.366199:0:14446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8191ce00/0xa6aa59fb12fa834a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8351 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.366210:0:14446:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8191ce00/0xa6aa59fb12fa834a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8351 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788636520.366254:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788636520.366256:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636520.366258:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636520.366259:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636520.366261:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636520.366262:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636520.366263:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636520.366265:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636520.366267:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636520.366269:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788636520.366272:0:14446:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788636520.366280:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788636520.366281:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636520.366282:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636520.366283:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636520.366284:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636520.366285:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636520.366286:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636520.366287:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636520.366288:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636520.366288:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788636520.366304:0:14446:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788636520.366327:0:14446:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976413568:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788636520.366364:0:14446:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636520.366380:0:14446:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d27ce40 going to sleep for 11 seconds 00000100:00100000:1.0:1788636520.366490:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976413568 00000100:00100000:1.0:1788636520.366496:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976413568 00000100:00100000:1.0:1788636520.366530:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788636520.366538:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14446:x1875520976413568:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788636520.366560:0:14459:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788636520.366574:0:14459:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788636520.368390:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976413312:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788636520.368453:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636520.371611:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976413312 00000100:00100000:1.0:1788636520.371623:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976413312 00000100:00100000:1.0:1788636520.371673:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636520.371681:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1875520976413312:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788636520.371769:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3279:x1875520976413312:12345-0@lo:38:llog_process_th.0 Request processed in 87us (3315us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788636520.371778:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636520.372658:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788636520.372674:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a37000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788636520.372679:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788636520.372683:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976413312:0@lo:38:llog_process_th.0 20000000:01000000:3.0:1788636520.418432:0:14459:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788636520.418450:0:14459:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788636520.418600:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788636520.418605:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788636520.418627:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.418647:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.418656:0:14480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.418712:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 12 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636520.418725:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 12 pid: 14458 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636520.418740:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875520976413696:0@lo:104: 00000100:00100000:2.0:1788636520.418837:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636520.418876:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd580d4180 going to sleep for 11 seconds 00000100:00100000:1.0:1788636520.419003:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976413696 00000100:00100000:1.0:1788636520.419010:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976413696 00000100:00100000:1.0:1788636520.419054:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636520.419063:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:14480:x1875520976413696:12345-0@lo:104: 00010000:00010000:1.0:1788636520.419075:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419134:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636520.419140:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:14480:x1875520976413696:12345-0@lo:104: Request processed in 79us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636520.419147:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788636520.419166:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636520.419171:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419178:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea400 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636520.419181:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419190:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636520.419197:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636520.419203:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636520.419230:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419237:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636520.419261:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419269:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea400/0xa6aa59fb12fa832e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8335 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419286:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636520.419288:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636520.419290:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636520.419330:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976413824:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636520.419362:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636520.419443:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976413824 00000100:00100000:1.0:1788636520.419447:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976413824 00010000:00010000:1.0:1788636520.419464:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 13 pid: 14458 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636520.419485:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636520.419491:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+13:3282:x1875520976413824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636520.419501:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636520.419505:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 13 pid: 14458 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419515:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 13 pid: 14458 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419531:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419539:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788636520.419563:0:14449:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000957901s 00010000:00010000:1.0:1788636520.419568:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419574:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419580:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419586:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419591:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eaa00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636520.419595:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419602:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419611:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636520.419621:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636520.419651:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+13:3282:x1875520976413824:12345-0@lo:103:ldlm_bl.0 Request processed in 160us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636520.419657:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636520.419690:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976413824:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636520.419843:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa8335 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa832e expref: 12 pid: 14458 timeout: 489 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636520.419852:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875520976413696:0@lo:104: 00010000:00010000:0.0:1788636520.419867:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.419874:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.419880:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636520.419886:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd6f4eaa00/0xa6aa59fb12fa8366 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636520.438835:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14446:x1875520976413568:12345-0@lo:253:mount.lustre.0 Request processed in 72249us (72421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636520.438851:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788636520.438985:0:14446:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14446:1875520976413568:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788636520.439000:0:14446:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788636520.439013:0:14446:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788636520.439014:0:14446:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788636520.439016:0:14446:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636520.439017:0:14446:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636520.439018:0:14446:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636520.439020:0:14446:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636520.439021:0:14446:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788636520.439023:0:14446:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788636520.439024:0:14446:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636520.439026:0:14446:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788636520.439045:0:14446:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788636520.447212:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788636520.447462:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788636520.447761:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788636520.447946:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788636520.448200:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788636520.448370:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788636520.450689:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788636520.450905:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788636520.452341:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788636520.452629:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788636520.452955:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788636520.453119:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1788636520.499907:0:14446:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788636520.500573:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788636520.500752:0:14501:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788636520.500757:0:14501:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1788636520.500968:0:14502:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1788636520.501033:0:14502:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1788636520.505700:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788636520.505833:0:14446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636520.506500:0:14502:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788636520.506558:0:14502:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1788636520.506562:0:14502:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1788636520.506850:0:14446:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788636520.506859:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788636520.507014:0:14446:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636520.508411:0:14446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788636520.509267:0:14446:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788636520.509325:0:14446:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1788636520.511532:0:14446:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1788636520.517036:0:14446:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788636520.539487:0:14446:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788636520.539521:0:14446:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb0a5c169f988 00100000:10000000:2.0:1788636520.539528:0:14446:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788636520.540271:0:14446:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788636520.540284:0:14446:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.157@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788636520.540300:0:14446:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788636520.540333:0:14446:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788636521.031590:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788636521.279870:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788636521.279878:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cfd610d7000 from 6 10000000:01000000:1.0:1788636521.279884:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788636521.279942:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636521.279955:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636521.279969:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636521.280246:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976413952:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636521.280393:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636521.280453:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d2819c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636521.280548:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976413952 00000100:00100000:2.0:1788636521.280557:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976413952 00000100:00100000:2.0:1788636521.280614:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788636521.280624:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14461:x1875520976413952:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636521.280637:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636521.280651:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa836d expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636521.280675:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636521.280698:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636521.280708:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eae00, rc 0) 00000100:00100000:2.0:1788636521.280758:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14461:x1875520976413952:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636521.280765:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788636521.281481:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976413952:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636521.281499:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636521.281509:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636521.281562:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976414080:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788636521.281600:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636521.281632:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d2819c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636521.281681:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976414080 00000100:00100000:3.0:1788636521.281687:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976414080 00000100:00100000:3.0:1788636521.281722:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788636521.281731:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14461:x1875520976414080:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788636521.281745:0:14459:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788636521.281761:0:14459:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788636521.281764:0:14459:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788636521.282110:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14461:x1875520976414080:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 380us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636521.282118:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788636521.285974:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976414080:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788636521.286034:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788636521.286045:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636521.286056:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636521.408281:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788636522.047932:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788636522.433153:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788636523.073629:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636524.103144:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788636524.918749:0:14745:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788636525.121785:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788636525.702515:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636525.702525:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636525.702529:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636525.702533:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636525.702536:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788636525.702540:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788636525.702544:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a37000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636525.702562:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cfd76a37000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636525.712013:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612cb800 x1875520976414336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636525.712232:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976414336:0@lo:38:kworker.0 00000100:00100000:1.0:1788636525.712345:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636525.712356:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3283:1875520976414208:0@lo:400:kworker.0 00000100:00100000:3.0:1788636525.712424:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636525.712517:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976414336 00000100:00100000:3.0:1788636525.712526:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976414336 00000100:00100000:3.0:1788636525.712571:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636525.712580:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1875520976414336:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788636525.712615:0:14466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 394 last 0 00000020:00000080:3.0:1788636525.712665:0:14466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xa6aa59fb12fa837b 00000004:00100000:3.0:1788636525.712683:0:14466:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788636525.712944:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a36000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636525.713010:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3279:x1875520976414336:12345-0@lo:38:kworker.0 Request processed in 429us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636525.713019:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636525.713052:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976414208 00000100:00100000:3.0:1788636525.713056:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976414208 00000100:00100000:3.0:1788636525.713092:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636525.713099:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:3283:x1875520976414208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636525.713137:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:3283:x1875520976414208:12345-0@lo:400:kworker.0 Request processed in 39us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636525.713145:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788636525.713263:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3283:1875520976414208:0@lo:400:kworker.0 00010000:00080000:3.0:1788636525.713431:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cfd612cb800 x1875520976414336/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636535 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788636525.713448:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788636525.713457:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788636525.713463:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788636525.713466:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a37000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788636525.713484:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3279:1875520976414336:0@lo:38:kworker.0 00010000:00010000:0.0:1788636526.142962:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636527.167954:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788636528.059314:0:14896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc91325630 20000000:00000080:0.0:1788636528.059332:0:14896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cfd7b231800 uarg=0000000000000000 20000000:01000000:0.0:1788636528.059433:0:14896:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1788636528.059441:0:14896:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1788636528.059446:0:14896:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788636528.062230:0:14897:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1788636528.062491:0:14896:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788636528.076222:0:14896:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788636528.076339:0:14896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636528.076357:0:14896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636528.076365:0:14896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636528.076680:0:14896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636528.076695:0:14896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 11 pid: 14458 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636528.076709:0:14896:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14896:1875520976414464:0@lo:104: 00000100:00100000:2.0:1788636528.078017:0:14896:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636528.078106:0:14896:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd580d4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636528.078150:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976414464 00000100:00100000:1.0:1788636528.078169:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976414464 00000100:00100000:1.0:1788636528.078254:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788636528.078288:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:14896:x1875520976414464:12345-0@lo:104: 00010000:00010000:1.0:1788636528.078310:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636528.078432:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636528.078439:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:14896:x1875520976414464:12345-0@lo:104: Request processed in 155us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636528.078448:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1788636528.078482:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636528.078490:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636528.078495:0:14896:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14896:1875520976414464:0@lo:104: 00010000:00010000:1.0:1788636528.078515:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea800 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636528.078521:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.078531:0:14896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636528.078533:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636528.078566:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636528.078575:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636528.078623:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636528.078630:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636528.078666:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636528.078952:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976414592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636528.079014:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636528.079536:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976414592 00000100:00100000:0.0:1788636528.079545:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976414592 00010000:00010000:0.0:1788636528.079581:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 12 pid: 14458 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636528.079610:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636528.079619:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:3280:x1875520976414592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636528.079632:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636528.079637:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 12 pid: 14458 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079648:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 12 pid: 14458 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079665:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd6f4ebe00/0xa6aa59fb12fa8343 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa833c expref: 12 pid: 14458 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079680:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079688:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079702:0:14449:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079709:0:14449:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079716:0:14449:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079734:0:14449:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079740:0:14449:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636528.079744:0:14449:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079752:0:14449:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079914:0:14449:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.079926:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636528.080093:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:3280:x1875520976414592:12345-0@lo:103:ldlm_bl.0 Request processed in 474us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636528.080102:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1788636528.080141:0:14896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.080151:0:14896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636528.080158:0:14896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd6f4ea000/0xa6aa59fb12fa8382 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636528.080504:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa833c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8343 expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636528.080535:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636528.080537:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636528.080540:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636528.081546:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976414592:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788636528.202938:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636529.218464:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788636529.791945:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788636529.791952:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd610d7000 from 10 10000000:01000000:1.0:1788636529.791958:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788636529.792006:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636529.792017:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636529.792026:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636529.792061:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976414720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636529.792289:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636529.792408:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd606d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788636529.794470:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976414720 00000100:00100000:3.0:1788636529.794486:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976414720 00000100:00100000:2.0:1788636529.794694:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788636529.794705:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+11:14461:x1875520976414720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636529.794721:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636529.794741:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa8389 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636529.794768:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636529.794779:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 12 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636529.794787:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ea400, rc 0) 00000100:00100000:2.0:1788636529.794877:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14461:x1875520976414720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636529.794883:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788636529.795073:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976414720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636529.795091:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636529.795110:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636529.795351:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976414848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636529.795396:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636529.795434:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd606d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788636529.795464:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976414848 00000100:00100000:3.0:1788636529.795469:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976414848 00000100:00100000:3.0:1788636529.795502:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636529.795509:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14461:x1875520976414848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636529.795853:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14461:x1875520976414848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 342us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636529.795862:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788636529.795903:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976414848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636529.795933:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976414976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636529.795969:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636529.795993:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd606d7540 going to sleep for 11 seconds 00000100:00100000:3.0:1788636529.797320:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976414976 00000100:00100000:3.0:1788636529.797329:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976414976 00000100:00100000:3.0:1788636529.797385:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636529.797395:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14461:x1875520976414976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636529.797613:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:14461:x1875520976414976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 219us (1642us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636529.797620:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788636529.797874:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976414976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788636529.799569:0:14975:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788636529.799724:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788636529.799745:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636529.799757:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636529.799769:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636530.240705:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788636530.815714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788636530.815721:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788636530.815724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788636530.815727:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788636530.815765:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636530.815785:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976415104:0@lo:400:kworker.0 00000100:00100000:1.0:1788636530.815785:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976415232:0@lo:400:kworker.0 00000100:00100000:1.0:1788636530.815909:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.815992:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976415232 00000100:00100000:1.0:1788636530.816000:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976415232 00000100:00100000:1.0:1788636530.816056:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636530.816067:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976415232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636530.816131:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976415232:12345-0@lo:400:kworker.0 Request processed in 65us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.816150:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788636530.816285:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cfd76a39c00 x1875520976415232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636546 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636530.816298:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976415232:0@lo:400:kworker.0 00000100:00100000:2.0:1788636530.816428:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636530.816703:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976415104 00000100:00100000:1.0:1788636530.816708:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976415104 00000100:00100000:1.0:1788636530.816745:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636530.816753:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:3280:x1875520976415104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636530.816830:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:3280:x1875520976415104:12345-0@lo:400:kworker.0 Request processed in 77us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636530.816836:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788636530.816883:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976415104:0@lo:400:kworker.0 00000100:00100000:1.0:1788636530.821341:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636520/real 1788636520] req@ffff9cfd7f92f800 x1875520976411648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636530.821389:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfd7f92f800 x1875520976411648/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636530.821400:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636520/real 1788636520] req@ffff9cfd612c9c00 x1875520976411520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636530 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636530.821411:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfd612c9c00 x1875520976411520/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636530 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788636530.821429:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636530.821456:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788636530.821460:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976411648:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788636530.821480:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd60e86000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636530.821486:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788636530.821489:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976411520:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788636530.821553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636530.821559:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788636530.821569:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cfd60e86000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636530.821574:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:0.0:1788636530.821580:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788636530.821587:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cfd60e86000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:0.0:1788636530.821619:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd6f6aed80 x1875520976415360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788636530.821647:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636530.821651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788636530.821653:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636530.821656:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 389 00000100:00080000:0.0:1788636530.821659:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788636530.821663:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cfd74e13800 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:0.0:1788636530.821675:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd6f6ae680 x1875520976415488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636530.821752:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976415360:0@lo:8:kworker.0 00000400:00000100:1.0:1788636530.821834:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875520976415360 offset 0 length 520: 4 00000100:00100000:1.0:1788636530.821883:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976415488:0@lo:8:kworker.0 00000400:00000100:1.0:1788636530.821922:0:3279:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875520976415488 offset 0 length 520: 4 00010000:00010000:1.0:1788636531.266856:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636532.287523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788636532.552484:0:15144:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788636532.552487:0:15144:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788636532.552601:0:15144:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cfd5d264800 00000020:01000004:2.0:1788636532.552614:0:15144:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788636532.552625:0:15144:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788636532.552637:0:15144:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cfd48dcb380) 00000020:00000080:2.0:1788636532.552652:0:15144:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788636532.585011:0:15144:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788636532.585598:0:15144:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788636532.586505:0:15144:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788636532.587110:0:15144:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788636532.587448:0:15144:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788636532.587981:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 453: rc = 0 00100000:10000000:3.0:1788636532.588427:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 453: rc = 0 00100000:10000000:3.0:1788636532.588530:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 453: rc = 0 00100000:10000000:3.0:1788636532.588986:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 640: rc = 0 00100000:10000000:3.0:1788636532.589508:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788636532.589754:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 640: rc = 0 00100000:10000000:3.0:1788636532.590071:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 640: rc = 0 00100000:10000000:3.0:1788636532.590501:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 640: rc = 0 00100000:10000000:3.0:1788636532.590744:0:15144:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 640: rc = 0 00000020:00000080:3.0:1788636532.591602:0:15144:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788636532.591614:0:15144:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788636532.591629:0:15144:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa6aa59fb12fa839e 00000020:01000004:3.0:1788636532.591636:0:15144:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788636532.591656:0:15144:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.157@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788636532.591659:0:15144:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788636532.591665:0:15144:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788636532.591670:0:15144:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788636532.591681:0:15144:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cfd5d2099c0) 00000020:00000080:3.0:1788636532.591694:0:15144:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1788636532.593448:0:15144:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788636532.593626:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788636532.593635:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788636532.594523:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788636532.594531:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788636532.596914:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788636532.596928:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788636532.598581:0:15144:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636532.598752:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788636532.598758:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788636532.599894:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788636532.599905:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788636532.634068:0:15144:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788636532.636752:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788636532.636764:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788636532.647383:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788636532.647398:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788636532.648879:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788636532.648891:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788636532.651019:0:15144:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636532.651529:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788636532.651534:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788636532.652555:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788636532.652565:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000040:00080000:3.0:1788636532.671458:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788636532.696650:0:15144:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788636532.696885:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788636532.696893:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1788636532.698981:0:15144:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1788636532.698993:0:15144:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788636532.699866:0:15144:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788636532.699896:0:15144:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788636532.699902:0:15144:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.157@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788636532.716562:0:15144:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.157@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788636532.716602:0:15144:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.157@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1788636532.716606:0:15144:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788636532.716613:0:15144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788636532.716614:0:15144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636532.716615:0:15144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636532.716616:0:15144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636532.716618:0:15144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636532.716619:0:15144:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788636532.716620:0:15144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636532.716622:0:15144:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636532.716625:0:15144:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1788636532.716627:0:15144:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788636532.716628:0:15144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788636532.716629:0:15144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636532.716630:0:15144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636532.716630:0:15144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636532.716631:0:15144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636532.716632:0:15144:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788636532.716633:0:15144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636532.716634:0:15144:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636532.716669:0:15144:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788636532.716690:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976415616:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788636532.716758:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.716843:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d281b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788636532.716924:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976415616 00000100:00100000:2.0:1788636532.716931:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976415616 00000100:00100000:2.0:1788636532.716976:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636532.716985:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:15144:x1875520976415616:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788636532.717024:0:14457:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788636532.717028:0:14457:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788636532.717031:0:14457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788636532.732004:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:15144:x1875520976415616:12345-0@lo:253:mount.lustre.0 Request processed in 15011us (15236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636532.732017:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788636532.732121:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976415616:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788636532.732153:0:15144:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788636532.732157:0:15144:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636532.732158:0:15144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788636532.732160:0:15144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636532.732161:0:15144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636532.732162:0:15144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636532.732164:0:15144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636532.732165:0:15144:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636532.732167:0:15144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636532.732168:0:15144:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788636532.732190:0:15144:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cfd5d264800 from lustre-OST0000 10000000:01000000:2.0:1788636532.732213:0:15144:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788636532.732216:0:15144:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788636532.732222:0:15144:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cfc42e4b380 local copy 00010000:00010000:2.0:1788636532.732242:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636532.732502:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976415744:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636532.732536:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636532.732616:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1d2240 going to sleep for 11 seconds 00000100:00100000:3.0:1788636532.735115:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976415744 00000100:00100000:3.0:1788636532.735128:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976415744 00000100:00100000:3.0:1788636532.735273:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788636532.735285:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:15144:x1875520976415744:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636532.735569:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:15144:x1875520976415744:12345-0@lo:501:mount.lustre.0 Request processed in 285us (3030us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788636532.735578:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788636532.735686:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976415744:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788636532.735711:0:15144:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788636532.735949:0:15144:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788636532.735959:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.735970:0:15144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636532.735996:0:15144:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cfd5d264800 10000000:01000000:2.0:1788636532.736006:0:15144:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788636532.736011:0:15144:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cfc42e4b380 10000000:01000000:2.0:1788636532.736013:0:15144:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788636532.736036:0:15144:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cfc42e4b380 from 1 10000000:01000000:2.0:1788636532.736039:0:15144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788636532.736069:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa83ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.736077:0:15144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa83ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.736086:0:15144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa83ac lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636532.736104:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976415872:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636532.736147:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636532.736171:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1d2240 going to sleep for 11 seconds 00000100:00100000:0.0:1788636532.736447:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976415872 00000100:00100000:0.0:1788636532.736453:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976415872 00000100:00100000:0.0:1788636532.736504:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788636532.736513:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+12:15144:x1875520976415872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636532.736523:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636532.736537:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa83b3 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa83ac expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.736559:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa83b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83ac expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.736578:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191c200/0xa6aa59fb12fa83b3 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83ac expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.736588:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c200, rc 0) 00000100:00100000:0.0:1788636532.736632:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+13:15144:x1875520976415872:12345-0@lo:101:mount.lustre.0 Request processed in 121us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636532.736638:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788636532.737015:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976415872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636532.737029:0:15144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa83ac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83b3 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.737038:0:15144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa83ac lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa83b3 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636532.737054:0:15144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788636532.737072:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa83ac lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83b3 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.737079:0:15144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea800/0xa6aa59fb12fa83ac lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83b3 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636532.737097:0:15144:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788636532.737101:0:15144:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788636532.737106:0:15144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788636532.737108:0:15144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788636532.737123:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea000/0xa6aa59fb12fa83ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.737130:0:15144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea000/0xa6aa59fb12fa83ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.737138:0:15144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea000/0xa6aa59fb12fa83ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636532.737151:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416000:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636532.737180:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636532.737210:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1d2240 going to sleep for 11 seconds 00000100:00100000:1.0:1788636532.737323:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976416000 00000100:00100000:1.0:1788636532.737327:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976416000 00000100:00100000:1.0:1788636532.737370:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788636532.737377:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+13:15144:x1875520976416000:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636532.737385:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636532.737396:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8196ac00/0xa6aa59fb12fa83c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa83ba expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636532.737410:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8196ac00/0xa6aa59fb12fa83c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83ba expref: 14 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636532.737419:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8196ac00/0xa6aa59fb12fa83c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83ba expref: 14 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636532.737425:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ac00, rc 0) 00000100:00100000:1.0:1788636532.737463:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416000:12345-0@lo:101:mount.lustre.0 Request processed in 87us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636532.737479:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788636532.737653:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416000:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636532.737665:0:15144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea000/0xa6aa59fb12fa83ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83c1 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.737672:0:15144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea000/0xa6aa59fb12fa83ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa83c1 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636532.738331:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788636532.739627:0:15144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788636532.739962:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788636532.740015:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788636532.740042:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788636532.740100:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788636532.740135:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788636532.740168:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788636532.740243:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788636532.740250:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788636532.740322:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636532.741437:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636532.741485:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636532.741570:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976416128 00000100:00100000:1.0:1788636532.741580:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976416128 00000100:00100000:1.0:1788636532.741674:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788636532.741685:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416128:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636532.742075:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416128:12345-0@lo:501:mount.lustre.0 Request processed in 391us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636532.742082:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788636532.742179:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416128:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636532.742217:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416256:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636532.742270:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636532.746095:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1d2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788636532.750634:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976416256 00000100:00100000:0.0:1788636532.750651:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976416256 00000100:00100000:0.0:1788636532.750713:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788636532.750722:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416256:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636532.751151:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416256:12345-0@lo:503:mount.lustre.0 Request processed in 428us (8877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636532.751159:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788636532.751186:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416256:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788636532.752100:0:15144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788636532.752170:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636532.752218:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636532.752262:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1d2600 going to sleep for 11 seconds 00000100:00100000:1.0:1788636532.752494:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976416384 00000100:00100000:1.0:1788636532.752501:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976416384 00000100:00100000:1.0:1788636532.752537:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788636532.752547:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636532.752733:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416384:12345-0@lo:502:mount.lustre.0 Request processed in 187us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636532.752740:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788636532.752852:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636532.761073:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788636532.761159:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788636532.761185:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788636532.761223:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788636532.761268:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788636532.761294:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788636532.761333:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788636532.761483:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788636532.761510:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788636532.761573:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788636532.761613:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788636532.761669:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788636532.761718:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416512:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636532.761791:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636532.761855:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d1d2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788636532.762019:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976416512 00000100:00100000:3.0:1788636532.762033:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976416512 00000100:00100000:3.0:1788636532.762090:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788636532.762099:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416512:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636532.762307:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416512:12345-0@lo:502:mount.lustre.0 Request processed in 209us (515us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636532.762315:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788636532.762872:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416512:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788636532.763258:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1788636532.763271:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788636532.765396:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636532.765406:0:15158:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788636532.765412:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636532.765414:0:15158:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788636532.765424:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636532.765439:0:15158:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cfd76a54d40) 00000020:00000080:1.0:1788636532.765460:0:15158:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788636532.765466:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788636532.765524:0:15158:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd5d264800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788636532.765539:0:15158:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788636532.765549:0:15158:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xa6aa59fb12fa83cf 00010000:00010000:1.0:1788636532.774699:0:15158:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788636532.775148:0:15158:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788636532.776782:0:15158:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788636532.788782:0:15158:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788636532.788826:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636532.788834:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636532.788837:0:15158:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788636532.788841:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788636532.788844:0:15158:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788636532.788846:0:15158:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636532.788847:0:15158:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788636532.788849:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788636532.788852:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636532.788853:0:15158:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788636532.788855:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636532.788858:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636532.788860:0:15158:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636532.788862:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636532.788864:0:15158:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788636532.788866:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636532.788868:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636532.788869:0:15158:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788636532.788871:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636532.788874:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636532.788875:0:15158:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788636532.788878:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788636532.788947:0:15158:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636532.788952:0:15158:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636532.788953:0:15158:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788636532.788957:0:15158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:3.0:1788636532.792648:0:15144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:3.0:1788636532.792748:0:15144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788636532.792764:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea000/0xa6aa59fb12fa83ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83c1 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636532.792778:0:15144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd6f4ea000/0xa6aa59fb12fa83ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83c1 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636532.792786:0:15144:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd5d264800 from 1 10000000:01000000:3.0:1788636532.792789:0:15144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636532.792844:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636532.792853:0:15144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636532.792865:0:15144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636532.792890:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416640:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788636532.793073:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636532.793123:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611580c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636532.794189:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976416640 00000100:00100000:1.0:1788636532.794199:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976416640 00000100:00100000:1.0:1788636532.794268:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788636532.794278:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+14:15144:x1875520976416640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636532.794292:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636532.794307:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa83d6 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636532.794335:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 15 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636532.794348:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 15 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636532.794358:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a800, rc 0) 00000100:00100000:1.0:1788636532.794408:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976416640:12345-0@lo:101:mount.lustre.0 Request processed in 133us (1336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636532.794415:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788636532.794515:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636532.794533:0:15144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.794543:0:15144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788636532.795121:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788636532.795604:0:15144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636532.795936:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788636532.796002:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788636532.796091:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788636532.796099:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788636532.796170:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636532.796220:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636532.796257:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976416768 00000100:00100000:2.0:1788636532.796264:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976416768 00000100:00100000:0.0:1788636532.796270:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d281840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636532.796303:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788636532.796312:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976416768:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636532.797573:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976416768:12345-0@lo:501:mount.lustre.0 Request processed in 1257us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636532.797585:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788636532.798347:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636532.798401:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636532.798458:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.798501:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d281840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636532.798570:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976416896 00000100:00100000:2.0:1788636532.798577:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976416896 00000100:00100000:2.0:1788636532.798611:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788636532.798620:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976416896:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636532.798834:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976416896:12345-0@lo:503:mount.lustre.0 Request processed in 214us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636532.798842:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788636532.798880:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976416896:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788636532.799386:0:15144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788636532.799446:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636532.799487:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.799550:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d281840 going to sleep for 11 seconds 00000100:00100000:1.0:1788636532.801198:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976417024 00000100:00100000:1.0:1788636532.801210:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976417024 00000100:00100000:2.0:1788636532.801412:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788636532.801422:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976417024:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636532.801671:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976417024:12345-0@lo:502:mount.lustre.0 Request processed in 249us (2182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636532.801680:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788636532.801775:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417024:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636532.802130:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788636532.802184:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788636532.802244:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788636532.802281:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788636532.802311:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788636532.802371:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788636532.802412:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788636532.802447:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788636532.802485:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417152:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636532.802532:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.803439:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976417152 00000100:00100000:0.0:1788636532.803448:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976417152 00000100:00100000:0.0:1788636532.803484:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788636532.803491:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976417152:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636532.803683:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976417152:12345-0@lo:502:mount.lustre.0 Request processed in 191us (1150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636532.803690:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788636532.803817:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd611580c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636532.803836:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417152:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636532.803939:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788636532.803950:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788636532.804830:0:15162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636532.804842:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636532.804844:0:15162:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788636532.804851:0:15162:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd5d264800 00000020:00000080:3.0:1788636532.804853:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636532.804860:0:15162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636532.804862:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636532.804864:0:15162:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788636532.804866:0:15162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636532.804869:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636532.804870:0:15162:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788636532.804873:0:15162:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd5d264800 00000020:00000080:3.0:1788636532.804876:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636532.804923:0:15162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636532.804927:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636532.804929:0:15162:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788636532.804931:0:15162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788636532.804940:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636532.804942:0:15162:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788636532.804946:0:15162:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cfd5d264800 00000020:00000080:3.0:1788636532.804948:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788636532.804987:0:15162:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788636532.804990:0:15162:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788636532.804992:0:15162:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788636532.804995:0:15162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1788636532.815054:0:15144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1788636532.815095:0:15144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636532.815117:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.815131:0:15144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636532.815198:0:15144:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788636532.815202:0:15144:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cfd5d264800 10000000:01000000:0.0:1788636532.815205:0:15144:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cfd5d264800 10000000:01000000:0.0:1788636532.815210:0:15144:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788636532.815215:0:15144:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd5d264800 from 1 10000000:01000000:0.0:1788636532.815218:0:15144:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788636532.824724:0:15144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8191c000/0xa6aa59fb12fa83e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.824742:0:15144:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8191c000/0xa6aa59fb12fa83e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.824753:0:15144:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8191c000/0xa6aa59fb12fa83e4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636532.824778:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788636532.824862:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.824906:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd69939480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636532.825793:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976417280 00000100:00100000:2.0:1788636532.825815:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976417280 00000100:00100000:2.0:1788636532.825876:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788636532.825886:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976417280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788636532.825905:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636532.825920:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa83eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa83e4 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.826017:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa83eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83e4 expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.826029:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd6f4ebc00/0xa6aa59fb12fa83eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83e4 expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636532.826038:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4ebc00, rc 0) 00000100:00100000:2.0:1788636532.826091:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417280:12345-0@lo:101:mount.lustre.0 Request processed in 207us (1229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636532.826097:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788636532.826135:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636532.826151:0:15144:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8191c000/0xa6aa59fb12fa83e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83eb expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.826161:0:15144:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8191c000/0xa6aa59fb12fa83e4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa83eb expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788636532.826719:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788636532.827029:0:15144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636532.827312:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788636532.827367:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788636532.827401:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788636532.827449:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788636532.827483:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788636532.827530:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788636532.827566:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788636532.827599:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788636532.827662:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788636532.827698:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788636532.827731:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788636532.827776:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788636532.827835:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788636532.827867:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788636532.827912:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788636532.829854:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788636532.829930:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788636532.830149:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788636532.830187:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788636532.830222:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788636532.830300:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788636532.830341:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788636532.830374:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788636532.830420:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788636532.830472:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1788636532.830507:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1788636532.830556:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1788636532.830594:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1788636532.830682:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1788636532.831783:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788636532.831904:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636532.832180:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.832261:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd69939480 going to sleep for 11 seconds 00000100:00100000:1.0:1788636532.837013:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976417408 00000100:00100000:1.0:1788636532.837026:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976417408 00000100:00100000:1.0:1788636532.837094:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788636532.837105:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636532.837651:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417408:12345-0@lo:501:mount.lustre.0 Request processed in 547us (5470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636532.837660:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788636532.843411:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636532.843475:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788636532.843555:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.843593:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd69939480 going to sleep for 11 seconds 00000100:00100000:2.0:1788636532.843824:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976417536 00000100:00100000:2.0:1788636532.843830:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976417536 00000100:00100000:2.0:1788636532.843877:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788636532.843886:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417536:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636532.844071:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417536:12345-0@lo:503:mount.lustre.0 Request processed in 185us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636532.844079:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788636532.844180:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417536:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788636532.844748:0:15144:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788636532.845021:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636532.845073:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.845102:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd69939480 going to sleep for 11 seconds 00000100:00100000:1.0:1788636532.846226:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976417664 00000100:00100000:1.0:1788636532.846479:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976417664 00000100:00100000:1.0:1788636532.846537:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788636532.846560:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636532.850152:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417664:12345-0@lo:502:mount.lustre.0 Request processed in 3585us (5068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636532.850169:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788636532.850848:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788636532.851297:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788636532.851351:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788636532.851377:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788636532.851428:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1788636532.851459:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1788636532.851499:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1788636532.851527:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1788636532.851552:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1788636532.851601:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1788636532.851628:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1788636532.851654:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1788636532.851688:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1788636532.851714:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1788636532.851739:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1788636532.851778:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1788636532.852015:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1788636532.852059:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1788636532.852110:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1788636532.852146:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1788636532.852172:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1788636532.852208:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1788636532.852252:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1788636532.852280:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1788636532.852316:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1788636532.852356:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1788636532.852382:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1788636532.852439:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788636532.852576:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788636532.852618:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788636532.852674:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788636532.852711:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788636532.852744:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788636532.852777:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788636532.854373:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788636532.854428:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788636532.854493:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788636532.854533:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788636532.854567:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788636532.854614:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788636532.854652:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788636532.854704:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636532.854783:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636532.854856:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d2883c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636532.855010:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976417792 00000100:00100000:2.0:1788636532.855019:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976417792 00000100:00100000:2.0:1788636532.855073:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788636532.855083:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417792:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636532.855481:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976417792:12345-0@lo:502:mount.lustre.0 Request processed in 399us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636532.855496:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788636532.855537:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976417792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788636532.855618:0:15144:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788636532.855629:0:15144:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788636532.859995:0:15167:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788636532.860010:0:15167:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cfd48dc99c0) 00000020:00000080:2.0:1788636532.860028:0:15167:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788636532.860106:0:15167:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd5d264800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788636532.860110:0:15167:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd5d264800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788636532.860113:0:15167:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd5d264800 3 00010000:00080000:2.0:1788636532.860140:0:15167:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd58a91000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.157@tcp at head 00010000:00010000:3.0:1788636532.864489:0:15167:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788636532.864702:0:15167:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788636532.864739:0:15167:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788636532.864753:0:15167:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xa6aa59fb12fa83f9 00000100:00080000:3.0:1788636532.864763:0:15167:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636532.864769:0:15167:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cfd58a91000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636532.864826:0:15167:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612cbb80 x1875520976417920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636532.864850:0:15167:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788636532.864873:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636532.864878:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636532.864881:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636532.864884:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788636532.864928:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976418048:0@lo:400:kworker.0 00000100:00100000:3.0:1788636532.864991:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636532.865045:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976418048 00000100:00100000:3.0:1788636532.865052:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976418048 00000100:00100000:3.0:1788636532.865088:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636532.865096:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976418048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636532.865142:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3283:x1875520976418048:12345-0@lo:400:kworker.0 Request processed in 46us (151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636532.865149:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788636532.865185:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cfd612cb100 x1875520976418048/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636548 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636532.865198:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3283:1875520976418048:0@lo:400:kworker.0 00000100:00100000:1.0:1788636532.866165:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1875520976417920:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788636532.866213:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636532.866604:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976417920 00000100:00100000:3.0:1788636532.866611:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976417920 00000100:00100000:3.0:1788636532.866636:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636532.866642:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1875520976417920:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788636532.866665:0:14466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 401 last 0 00000020:00000080:3.0:1788636532.866914:0:14466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xa6aa59fb12fa8400 00000004:00100000:3.0:1788636532.866931:0:14466:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788636532.866966:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9cfd76a13800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788636532.867020:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3279:x1875520976417920:12345-0@lo:38:llog_process_th.0 Request processed in 376us (806us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636532.867029:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788636532.867621:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cfd612cbb80 x1875520976417920/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636542 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636532.867634:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636532.867642:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788636532.867649:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788636532.867654:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788636532.867657:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd58a91000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636532.867663:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3279:1875520976417920:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788636532.868075:0:15167:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788636532.868201:0:15144:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788636532.868226:0:15144:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788636532.868257:0:15144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8191c000/0xa6aa59fb12fa83e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83eb expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636532.868269:0:15144:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8191c000/0xa6aa59fb12fa83e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa83eb expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788636532.868311:0:15144:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788636532.868313:0:15144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636532.868315:0:15144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636532.868316:0:15144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636532.868318:0:15144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636532.868319:0:15144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636532.868320:0:15144:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636532.868322:0:15144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636532.868323:0:15144:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636532.868327:0:15144:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788636532.868330:0:15144:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788636532.868335:0:15144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636532.868336:0:15144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636532.868337:0:15144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636532.868338:0:15144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636532.868339:0:15144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636532.868339:0:15144:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636532.868340:0:15144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636532.868341:0:15144:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788636532.868361:0:15144:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788636532.868376:0:15144:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976418176:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788636532.868425:0:15144:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636532.869930:0:15144:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f947a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636532.870085:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976418176 00000100:00100000:3.0:1788636532.870094:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976418176 00000100:00100000:3.0:1788636532.870139:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636532.870149:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15144:x1875520976418176:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788636532.870189:0:14458:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788636532.870204:0:14458:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788636532.907687:0:14458:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788636532.907700:0:14458:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788636532.908293:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788636532.908299:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788636532.908321:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.908498:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.908508:0:14480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.908548:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 16 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.908564:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 16 pid: 14457 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636532.908578:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875520976418304:0@lo:104: 00000100:00100000:0.0:1788636532.908640:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.908681:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd69939cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636532.909846:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976418304 00000100:00100000:0.0:1788636532.909868:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976418304 00000100:00100000:0.0:1788636532.909917:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636532.909927:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:14480:x1875520976418304:12345-0@lo:104: 00010000:00010000:0.0:1788636532.909942:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910008:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788636532.910014:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:14480:x1875520976418304:12345-0@lo:104: Request processed in 90us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636532.910021:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788636532.910041:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636532.910047:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910053:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ba00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636532.910057:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910065:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636532.910072:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636532.910077:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788636532.910106:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910113:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788636532.910132:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910147:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa836d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8374 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910177:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636532.910179:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636532.910180:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636532.910205:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976418432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788636532.910248:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636532.910296:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976418432 00000100:00100000:0.0:1788636532.910300:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976418432 00010000:00010000:0.0:1788636532.910315:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 17 pid: 14457 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636532.910336:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636532.910349:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:3280:x1875520976418432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636532.910359:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636532.910363:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 17 pid: 14457 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910373:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 17 pid: 14457 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910389:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910396:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788636532.910409:0:14451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002110977s 00010000:00010000:0.0:1788636532.910419:0:14451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910426:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910432:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910438:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910443:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191dc00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636532.910447:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910454:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910463:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910472:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636532.910500:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:3280:x1875520976418432:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636532.910506:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636532.910540:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976418432:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636532.910570:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd6f4eae00/0xa6aa59fb12fa8374 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa836d expref: 16 pid: 14457 timeout: 501 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636532.910580:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875520976418304:0@lo:104: 00010000:00010000:0.0:1788636532.910599:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910608:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910614:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636532.910621:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd8191dc00/0xa6aa59fb12fa8407 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636532.927017:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:15144:x1875520976418176:12345-0@lo:253:mount.lustre.0 Request processed in 56860us (58583us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636532.927031:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788636532.927142:0:15144:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15144:1875520976418176:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788636532.927157:0:15144:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788636532.927171:0:15144:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788636532.927173:0:15144:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788636532.927174:0:15144:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636532.927175:0:15144:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636532.927177:0:15144:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636532.927178:0:15144:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636532.927179:0:15144:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636532.927181:0:15144:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636532.927182:0:15144:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788636532.927198:0:15144:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788636532.935102:0:15144:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636532.935316:0:15144:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788636532.935628:0:15144:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636532.936377:0:15144:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788636532.936877:0:15144:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636532.937115:0:15144:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788636532.939474:0:15144:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1788636532.977847:0:15144:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1788636532.977854:0:15144:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1788636532.977894:0:15144:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788636532.977952:0:15144:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.157@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788636532.977967:0:15144:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1788636532.977994:0:15144:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1788636533.311639:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788636534.334984:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788636534.334992:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cfd610d7000 from 7 10000000:01000000:0.0:1788636534.334997:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788636534.335038:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636534.335051:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636534.335061:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636534.335087:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976418560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636534.335156:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636534.335197:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd75932780 going to sleep for 11 seconds 00010000:00010000:2.0:1788636534.336004:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636534.336022:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976418560 00000100:00100000:2.0:1788636534.336030:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976418560 00000100:00100000:2.0:1788636534.336077:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788636534.336087:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+15:14461:x1875520976418560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636534.336100:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636534.336115:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa840e expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636534.336139:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 16 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636534.336149:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 16 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636534.336176:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd6f4eb400, rc 0) 00000100:00100000:2.0:1788636534.336239:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:14461:x1875520976418560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636534.336246:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788636534.336292:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976418560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636534.336308:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636534.336316:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636534.336366:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976418688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788636534.336396:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636534.336416:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd471c4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636534.336553:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976418688 00000100:00100000:0.0:1788636534.336558:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976418688 00000100:00100000:0.0:1788636534.336586:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788636534.336593:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:14461:x1875520976418688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788636534.336613:0:14457:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788636534.336627:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788636534.336630:0:14457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:0.0:1788636534.336696:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:14461:x1875520976418688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 103us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636534.336713:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788636534.337784:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976418688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788636534.337873:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788636534.337882:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636534.337891:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636535.360834:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636536.383046:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636537.407852:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788636537.996459:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636537.996465:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788636537.996468:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636537.996471:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788636537.996515:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3281:1875520976418816:0@lo:400:kworker.0 00000100:00100000:0.0:1788636537.996580:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636537.996639:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976418944:0@lo:400:kworker.0 00000100:00100000:0.0:1788636537.996670:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636537.996690:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636537.996695:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976419072:0@lo:400:kworker.0 00000100:00100000:0.0:1788636537.996716:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636537.996744:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976418816 00000100:00100000:0.0:1788636537.996750:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976418816 00000100:00100000:0.0:1788636537.996789:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636537.996817:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:3281:x1875520976418816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636537.996864:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:3281:x1875520976418816:12345-0@lo:400:kworker.0 Request processed in 67us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636537.996871:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788636537.996913:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976418944 00000100:00100000:0.0:1788636537.996917:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976418944 00000100:00100000:0.0:1788636537.996938:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976419072 00000100:00100000:0.0:1788636537.996940:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976419072 00000100:00100000:0.0:1788636537.996969:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636537.996975:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976418944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636537.997007:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976418944:12345-0@lo:400:kworker.0 Request processed in 32us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636537.997013:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636537.997024:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636537.997030:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976419072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636537.997053:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976419072:12345-0@lo:400:kworker.0 Request processed in 24us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636537.997058:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636537.997093:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3281:1875520976418816:0@lo:400:kworker.0 00010000:00080000:0.0:1788636537.997123:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd6f6af100 x1875520976419072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636537.997135:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976419072:0@lo:400:kworker.0 00010000:00080000:0.0:1788636537.997144:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd6f6adf80 x1875520976418944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636537.997152:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976418944:0@lo:400:kworker.0 00000100:00080000:3.0:1788636537.998439:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636538.432951:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788636538.713767:0:15514:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788636539.455008:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636540.482768:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636541.504784:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636542.527021:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788636542.914950:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:3.0:1788636543.104852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636543.104862:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788636543.104865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636543.104869:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788636543.104893:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976419200:0@lo:400:kworker.0 00000100:00100000:3.0:1788636543.104987:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636543.105054:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976419200 00000100:00100000:2.0:1788636543.105064:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976419200 00000100:00100000:3.0:1788636543.105093:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976419328:0@lo:400:kworker.0 00000100:00100000:2.0:1788636543.105131:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788636543.105136:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636543.105143:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:3280:x1875520976419200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636543.105181:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976419328 00000100:00100000:3.0:1788636543.105185:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976419328 00000100:00100000:2.0:1788636543.105210:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:3280:x1875520976419200:12345-0@lo:400:kworker.0 Request processed in 69us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636543.105217:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636543.105219:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788636543.105223:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976419328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636543.105261:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976419328:12345-0@lo:400:kworker.0 Request processed in 37us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636543.105267:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788636543.105310:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd612c8000 x1875520976419328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636543.105326:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976419328:0@lo:400:kworker.0 00000100:00100000:3.0:1788636543.105353:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976419200:0@lo:400:kworker.0 00000100:00100000:3.0:1788636543.105399:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636543.105423:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976419456:0@lo:400:kworker.0 00000100:00100000:3.0:1788636543.105455:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636543.105483:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976419456 00000100:00100000:3.0:1788636543.105487:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976419456 00000100:00100000:3.0:1788636543.105532:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788636543.105539:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976419456:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788636543.105561:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788636543.105574:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976419456:12345-0@lo:400:kworker.0 Request processed in 36us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636543.105580:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788636543.105605:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd612cb100 x1875520976419456/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636559 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636543.105616:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976419456:0@lo:400:kworker.0 00010000:00010000:0.0:1788636543.551102:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636544.577458:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636545.086867:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636530/real 1788636530] req@ffff9cfd6f6aed80 x1875520976415360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636545.086897:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfd6f6aed80 x1875520976415360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636545.086907:0:3279:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788636530/real 1788636530] req@ffff9cfd6f6ae680 x1875520976415488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636545 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636545.086918:0:3279:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cfd6f6ae680 x1875520976415488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788636545 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788636545.086934:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd60e86000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636545.086972:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788636545.086977:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976415360:0@lo:8:kworker.0 00000100:00080000:1.0:1788636545.086983:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636545.086988:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788636545.086991:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976415488:0@lo:8:kworker.0 00000100:00080000:3.0:1788636545.087116:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636545.087121:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788636545.087124:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cfd60e86000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636545.087129:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1788636545.087134:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788636545.087141:0:37:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cfd60e86000 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636545.087170:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612c8700 x1875520976419712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788636545.087185:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788636545.087188:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788636545.087190:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788636545.087193:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 399 00000100:00080000:3.0:1788636545.087195:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788636545.087206:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cfd74e13800 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636545.087219:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612c9180 x1875520976419840/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788636545.087272:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976419968:0@lo:400:kworker.0 00000100:00100000:3.0:1788636545.087331:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.087384:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788636545.087390:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976420096:0@lo:400:kworker.0 00000100:00100000:3.0:1788636545.087413:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.087446:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976419968 00000100:00100000:3.0:1788636545.087453:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976419968 00000100:00100000:3.0:1788636545.087490:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976420096 00000100:00100000:3.0:1788636545.087493:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976420096 00000100:00100000:3.0:1788636545.087518:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636545.087526:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976419968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636545.087573:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976419968:12345-0@lo:400:kworker.0 Request processed in 48us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636545.087580:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636545.087597:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636545.087603:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976420096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636545.087641:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976420096:12345-0@lo:400:kworker.0 Request processed in 26us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636545.087647:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1788636545.087733:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788636545.087757:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd612ca300 x1875520976420096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636545.087769:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976420096:0@lo:400:kworker.0 00010000:00080000:3.0:1788636545.087819:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd612cad80 x1875520976419968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636561 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788636545.087829:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976419968:0@lo:400:kworker.0 00000100:00100000:3.0:1788636545.087849:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976419712:0@lo:8:kworker.0 00000100:00100000:3.0:1788636545.087879:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.087903:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976419840:0@lo:8:kworker.0 00000100:00100000:3.0:1788636545.087926:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636545.088005:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636545.088015:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976419584:0@lo:400:kworker.0 00000100:00100000:1.0:1788636545.088048:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636545.088246:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976419712 00000100:00100000:0.0:1788636545.088252:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976419712 00000100:00100000:3.0:1788636545.088334:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976419584 00000100:00100000:3.0:1788636545.088338:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976419584 00000100:00100000:3.0:1788636545.088366:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788636545.088374:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:3282:x1875520976419584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636545.088413:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:3282:x1875520976419584:12345-0@lo:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636545.088419:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788636545.088455:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976419584:0@lo:400:kworker.0 00000100:00100000:0.0:1788636545.088509:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976419840 00000100:00100000:0.0:1788636545.088513:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976419840 00000100:00100000:0.0:1788636545.088636:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636545.088642:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1875520976419712:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1788636545.088674:0:15145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:0.0:1788636545.088704:0:15145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa841c 00002000:00100000:0.0:1788636545.088718:0:15145:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cfc42bc6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788636545.088722:0:15145:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788636545.088725:0:15145:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788636545.089079:0:15145:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788636545.089105:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9cfc42bc6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636545.089166:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875520976419712:12345-0@lo:8:kworker.0 Request processed in 524us (1285us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636545.089173:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636545.089192:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636545.089196:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1875520976419840:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788636545.089207:0:15145:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788636545.089233:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612ca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1875520976419840:12345-0@lo:8:kworker.0 Request processed in 35us (1305us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788636545.089238:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788636545.089398:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd612c8700 x1875520976419712/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636545.089409:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636545.089416:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788636545.089423:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788636545.089427:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788636545.089430:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd60e86000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788636545.089686:0:14487:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1788636545.089706:0:14487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1875520976420352:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788636545.089738:0:14487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.089760:0:14487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636545.089771:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788636545.089780:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976420224:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636545.089828:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.089865:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976420352 00000100:00100000:3.0:1788636545.089869:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976420352 00000100:00100000:3.0:1788636545.089909:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636545.089917:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14487:x1875520976420352:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1788636545.092603:0:15145:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788636545.092613:0:15145:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788636545.092618:0:15145:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000004:00080000:1.0:1788636545.093398:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788636545.093412:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976419712:0@lo:8:kworker.0 00000100:00080000:1.0:1788636545.093449:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636545.093453:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788636545.093457:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976419840:0@lo:8:kworker.0 00000100:00100000:1.0:1788636545.093617:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976420224 00000100:00100000:1.0:1788636545.093634:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976420224 00000100:00100000:1.0:1788636545.093689:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788636545.093699:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875520976420224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636545.093733:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636545.093830:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3283:x1875520976420224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (4001us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636545.093837:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788636545.093874:0:3283:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd612cb100 x1875520976420224/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636561 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636545.093891:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976420224:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788636545.096866:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788636545.100851:0:14486:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788636545.101301:0:14486:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414125503345ns, next at 0ns, rc = 0 00002000:00010000:2.0:1788636545.140698:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.140712:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140730:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.140734:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.140741:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140757:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140767:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140787:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140821:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636545.140833:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636545.140838:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140845:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eac00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636545.140849:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140858:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140872:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140879:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d6722250/0xa6aa59fb12fa8423 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.140893:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.140895:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.140896:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.141484:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.141498:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.141507:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.141511:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.141516:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.141526:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.141535:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.141542:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.141624:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636545.141625:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.141631:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.141639:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ebe00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.141643:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.141658:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.141672:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.141680:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a48c7b3/0xa6aa59fb12fa842a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.141695:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.141696:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.141698:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.142004:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.142010:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142019:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.142022:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.142025:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142035:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142050:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142057:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142080:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636545.142426:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.142431:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.142439:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eae00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.142443:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.142450:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.142463:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.142483:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000540b3a6/0xa6aa59fb12fa8431 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.142497:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.142499:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.142500:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.142870:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.142876:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142885:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.142888:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.142893:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142909:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142916:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142924:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.142955:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636545.142985:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.142991:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.142998:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.143002:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.143010:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.143023:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.143032:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.143034:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.143036:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.143106:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010b32b77/0xa6aa59fb12fa8438 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.144553:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.144563:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.144576:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.144580:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.144586:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.144598:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.144607:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.144615:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.144641:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636545.145309:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.145317:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.145339:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eaa00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.145343:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.145352:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.145369:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.145377:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000320a6c36/0xa6aa59fb12fa843f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.145398:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.145400:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.145402:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.145788:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.145824:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.145840:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.145844:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.145848:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.145858:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.145866:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.145873:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.145892:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636545.146126:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.146132:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.146141:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4ea200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.146153:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.146162:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.146181:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.146189:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000504f4fab/0xa6aa59fb12fa8446 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.146205:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.146206:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.146208:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.146783:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.146791:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.146832:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.146837:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.146842:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.146853:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.146873:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.146881:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.146898:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636545.147181:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.147187:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.147195:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.147199:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.147207:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.147221:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.147229:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000032d0901/0xa6aa59fb12fa844d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.147332:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.147335:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.147337:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.147951:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.147959:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.147981:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.147985:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.147990:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.148012:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.148021:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.148029:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.148386:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788636545.148884:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.148891:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.148901:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.148905:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.148909:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.148921:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.148929:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.148937:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788636545.149503:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:0.0:1788636545.149503:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636545.149514:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149524:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eba00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.149528:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149538:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149555:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149563:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b5b8ddc/0xa6aa59fb12fa8454 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149584:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.149588:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149594:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd6f4eb800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.149606:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149614:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149625:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.149632:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.149634:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.149636:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.149702:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.149707:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076260df2/0xa6aa59fb12fa845b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.150465:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.150472:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.150488:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.150492:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.150498:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.150511:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.150520:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.150528:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.150648:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.150654:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.150661:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.150664:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.150673:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.150686:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.150694:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.150704:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.150706:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.150777:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.150783:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ed0aa84b/0xa6aa59fb12fa8462 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.151309:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.151315:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.151324:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.151328:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.151332:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.151354:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.151363:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.151370:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.151651:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.151658:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.151667:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffa00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.151671:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.151678:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.151692:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.151702:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.151704:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.151707:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.151778:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.151784:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af12d6be/0xa6aa59fb12fa8469 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.152528:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.152536:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.152546:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.152550:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.152556:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.152567:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.152586:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.152593:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.152699:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.152706:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.152713:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.152716:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.152725:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.152746:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.152755:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.152758:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.152760:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.152884:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.152890:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e1a20a4/0xa6aa59fb12fa8470 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.153569:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.153576:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.153585:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.153589:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.153594:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.153605:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.153614:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.153632:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.153724:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.153730:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.153737:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe400 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.153740:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.153747:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.153759:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.153766:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.153768:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.153769:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.153873:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.153879:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7a59176/0xa6aa59fb12fa8477 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.154235:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.154758:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.154766:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.154775:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.154779:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.154784:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.154821:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.154831:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.154838:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.154865:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636545.155094:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.155101:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.155115:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.155119:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.155128:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.155142:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.155161:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084b71135/0xa6aa59fb12fa847e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.155177:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.155179:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.155181:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.155526:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.155533:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.155542:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.155545:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.155550:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.155569:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.155578:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.155584:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.155704:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788636545.156117:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.156124:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.156132:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.156142:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.156156:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.156166:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.156175:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.156183:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156446:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636545.156451:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156459:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fee00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.156462:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156471:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156492:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156500:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f32c5068/0xa6aa59fb12fa8485 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156517:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.156520:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156527:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.156530:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156537:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156546:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.156553:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.156555:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.156568:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.156731:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.156736:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000175baeb4/0xa6aa59fb12fa848c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.157225:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.157231:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.157242:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.157245:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.157249:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.157260:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.157274:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.157281:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.157327:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.157396:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.157415:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fea00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.157418:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.157426:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.157439:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.157447:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.157448:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.157450:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.157503:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.157508:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004209f9bc/0xa6aa59fb12fa8493 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.157932:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.157938:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.157946:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.157949:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.157953:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.157963:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.157971:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.157991:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.158162:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.158168:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.158175:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff400 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.158179:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.158188:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.158200:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.158215:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.158217:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.158219:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.158279:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.158284:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076f5a38/0xa6aa59fb12fa849a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.158876:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.158883:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.158892:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.158896:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.158913:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.158925:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.158933:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.158941:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.159239:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.159246:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.159254:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fec00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.159258:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.159266:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.159278:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.159286:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.159288:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.159289:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.159324:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.159375:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b6db6d6/0xa6aa59fb12fa84a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.159763:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788636545.160244:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.160251:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.160261:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.160265:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.160270:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.160280:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.160288:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.160296:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.160457:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788636545.161109:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.161116:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.161131:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.161135:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.161140:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.161162:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.161171:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.161179:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161443:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636545.161452:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161462:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.161472:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161483:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161499:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161507:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012017c62/0xa6aa59fb12fa84a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161531:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.161535:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161542:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffc00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.161546:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161554:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161576:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.161584:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.161593:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.161595:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.161758:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.161764:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000234c1227/0xa6aa59fb12fa84af lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.162425:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.162433:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.162444:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.162448:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.162454:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.162477:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.162486:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.162494:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.162547:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.162554:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.162574:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffe00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.162578:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.162587:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.162600:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.162608:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.162610:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.162612:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.162827:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.162833:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd5b2772/0xa6aa59fb12fa84b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.163556:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.163684:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.163695:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.163699:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.163704:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.163716:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.163739:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.163747:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.164409:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.164417:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.164426:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.164430:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.164439:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.164461:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.164469:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.164471:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.164473:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.164947:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.164954:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3dcabbc/0xa6aa59fb12fa84bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.165834:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.165842:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.165855:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.165859:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.165865:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.165877:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.165887:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.165907:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.165969:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.165976:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.165984:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.165988:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.165997:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.166011:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.166020:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.166021:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.166023:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.166089:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.166094:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afd8ecdc/0xa6aa59fb12fa84c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.166771:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.166778:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.166788:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.166792:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.166825:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.166837:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.166846:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.166854:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.166952:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.166959:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.166979:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.166983:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.166991:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.167004:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.167012:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.167014:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.167016:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.167080:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.167085:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9b28c14/0xa6aa59fb12fa84cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.167810:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.167817:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.167827:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.167831:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.167836:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.167845:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.167854:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.167862:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.167949:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.167956:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.167963:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c0a00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.167967:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.167976:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.167988:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.168003:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.168005:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.168006:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.168111:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.168116:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008382ddb4/0xa6aa59fb12fa84d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.168848:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.168855:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.168866:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.168869:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.168874:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.168885:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.168894:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.168901:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.168950:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.168956:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.168963:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c1600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.168967:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.168976:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.168990:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.168999:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.169000:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.169002:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.169072:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.169078:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000042d5613e/0xa6aa59fb12fa84d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636545.169815:0:15145:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788636545.169826:0:15145:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.169846:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=414s v=(0 0) 00010000:00010000:2.0:1788636545.169850:0:15145:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636545.169855:0:15145:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.169865:0:15145:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.169874:0:15145:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636545.169882:0:15145:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.169936:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636545.169943:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.169950:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c1e00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636545.169954:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.169969:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.169983:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636545.169992:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.169994:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636545.169996:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636545.170062:0:15145:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788636545.170068:0:15145:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000099d21c90/0xa6aa59fb12fa84e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15145 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1788636545.170371:0:15145:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1788636545.170545:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14487:x1875520976420352:12345-0@lo:5:osp-pre-0-0.0 Request processed in 80600us (80777us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636545.170569:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788636545.170870:0:14487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1875520976420352:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788636545.170886:0:14487:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00010000:00010000:0.0:1788636545.170927:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636545.170931:0:14487:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1875520976420480:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788636545.171049:0:14487:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636545.171105:0:14487:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd613c4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636545.171161:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976420480 00000100:00100000:2.0:1788636545.171168:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976420480 00000100:00100000:2.0:1788636545.171212:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788636545.171221:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14487:x1875520976420480:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788636545.171269:0:15148:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788636545.188141:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14487:x1875520976420480:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16870us (17041us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788636545.188193:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636545.188506:0:14487:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14487:1875520976420480:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788636545.188522:0:14487:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1788636545.612132:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788636546.202892:0:15864:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788636546.202896:0:15864:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1788636546.202999:0:15864:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cfd7abc6000 00000020:01000004:1.0:1788636546.203014:0:15864:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788636546.203026:0:15864:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1788636546.203040:0:15864:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cfd76a53380) 00000020:00000080:1.0:1788636546.203057:0:15864:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788636546.234388:0:15864:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788636546.234917:0:15864:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788636546.238104:0:15864:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788636546.239212:0:15864:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1788636546.239679:0:15864:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788636546.240479:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 531: rc = 0 00100000:10000000:3.0:1788636546.240574:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 531: rc = 0 00100000:10000000:3.0:1788636546.241529:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 531: rc = 0 00100000:10000000:3.0:1788636546.242578:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 251: rc = 0 00100000:10000000:3.0:1788636546.242844:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 251: rc = 0 00100000:10000000:2.0:1788636546.244996:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 251: rc = 0 00100000:10000000:2.0:1788636546.245314:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 251: rc = 0 00100000:10000000:2.0:1788636546.245541:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 251: rc = 0 00100000:10000000:2.0:1788636546.245785:0:15864:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 251: rc = 0 00000020:00000080:2.0:1788636546.246422:0:15864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788636546.246434:0:15864:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788636546.246445:0:15864:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa6aa59fb12fa84ee 00000020:01000004:2.0:1788636546.246452:0:15864:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788636546.246471:0:15864:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.157@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788636546.246474:0:15864:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.157@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788636546.246479:0:15864:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788636546.246497:0:15864:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788636546.246500:0:15864:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.157@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1788636546.276781:0:15864:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.157@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788636546.276857:0:15864:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.157@tcp, index=0001, flags=0x20002 00000020:01000004:0.0:1788636546.276862:0:15864:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788636546.276864:0:15864:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788636546.276865:0:15864:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636546.276867:0:15864:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636546.276868:0:15864:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636546.276869:0:15864:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636546.276871:0:15864:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788636546.276873:0:15864:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636546.276874:0:15864:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636546.276878:0:15864:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:0.0:1788636546.276880:0:15864:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788636546.276881:0:15864:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788636546.276882:0:15864:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788636546.276883:0:15864:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788636546.276884:0:15864:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788636546.276891:0:15864:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788636546.276892:0:15864:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788636546.276893:0:15864:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788636546.276894:0:15864:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788636546.276919:0:15864:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788636546.276939:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976420608:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788636546.277024:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636546.277077:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd502c93c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636546.277882:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976420608 00000100:00100000:2.0:1788636546.277892:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976420608 00000100:00100000:2.0:1788636546.277949:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788636546.277958:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15864:x1875520976420608:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788636546.278013:0:14457:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788636546.278016:0:14457:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788636546.278020:0:14457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788636546.291570:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15864:x1875520976420608:12345-0@lo:253:mount.lustre.0 Request processed in 13604us (14537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.291585:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788636546.291709:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6adf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976420608:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788636546.291747:0:15864:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788636546.291751:0:15864:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788636546.291753:0:15864:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788636546.291754:0:15864:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788636546.291755:0:15864:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788636546.291757:0:15864:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788636546.291758:0:15864:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788636546.291759:0:15864:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788636546.291761:0:15864:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788636546.291763:0:15864:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788636546.291787:0:15864:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cfd7abc6000 from lustre-OST0001 10000000:01000000:3.0:1788636546.291853:0:15864:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788636546.291856:0:15864:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788636546.291865:0:15864:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cfc42e4b380 local copy 00010000:00010000:3.0:1788636546.291878:0:15864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636546.292166:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976420736:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636546.292205:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636546.292240:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd48e83780 going to sleep for 11 seconds 00000100:00100000:0.0:1788636546.292748:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976420736 00000100:00100000:0.0:1788636546.292755:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976420736 00000100:00100000:0.0:1788636546.292834:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788636546.292843:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15864:x1875520976420736:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636546.293044:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15864:x1875520976420736:12345-0@lo:501:mount.lustre.0 Request processed in 202us (838us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636546.293052:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788636546.293205:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976420736:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788636546.293221:0:15864:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.157@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788636546.293519:0:15864:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.157@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788636546.293528:0:15864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.293537:0:15864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8196a400/0xa6aa59fb12fa8294 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa829b expref: -99 pid: 14446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636546.293562:0:15864:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cfd7abc6000 10000000:01000000:1.0:1788636546.293567:0:15864:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788636546.293573:0:15864:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788636546.293575:0:15864:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788636546.293580:0:15864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788636546.293589:0:15864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788636546.293616:0:15864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa84f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.293625:0:15864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa84f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.293635:0:15864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa84f5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636546.293652:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976420864:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788636546.293955:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636546.293981:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7a402180 going to sleep for 11 seconds 00000100:00100000:3.0:1788636546.294253:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976420864 00000100:00100000:3.0:1788636546.294259:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976420864 00000100:00100000:3.0:1788636546.294399:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788636546.294407:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:15864:x1875520976420864:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636546.294419:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636546.294431:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997da00/0xa6aa59fb12fa84fc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa84f5 expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.294454:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997da00/0xa6aa59fb12fa84fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa84f5 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.294464:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997da00/0xa6aa59fb12fa84fc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa84f5 expref: 17 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.294480:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997da00, rc 0) 00000100:00100000:3.0:1788636546.294518:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976420864:12345-0@lo:101:mount.lustre.0 Request processed in 112us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636546.294523:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788636546.294610:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976420864:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636546.294624:0:15864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa84f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa84fc expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.294633:0:15864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa84f5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa84fc expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788636546.295560:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788636546.297644:0:15864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788636546.297922:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788636546.297967:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788636546.298120:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788636546.298190:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788636546.298230:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788636546.298263:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788636546.298334:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788636546.298341:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788636546.298442:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976420992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636546.298514:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636546.298566:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7a402900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636546.298714:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976420992 00000100:00100000:2.0:1788636546.298722:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976420992 00000100:00100000:2.0:1788636546.298768:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788636546.298778:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976420992:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788636546.299178:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976420992:12345-0@lo:501:mount.lustre.0 Request processed in 400us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636546.299194:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788636546.299720:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976420992:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788636546.299759:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421120:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636546.299819:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636546.299842:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7a402900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636546.302517:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976421120 00000100:00100000:2.0:1788636546.302533:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976421120 00000100:00100000:2.0:1788636546.302607:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788636546.302618:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976421120:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788636546.303050:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976421120:12345-0@lo:503:mount.lustre.0 Request processed in 433us (3229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636546.303058:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788636546.306477:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421120:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788636546.307158:0:15864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788636546.307241:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421248:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636546.307759:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636546.307877:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7a402900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636546.307949:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976421248 00000100:00100000:0.0:1788636546.307957:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976421248 00000100:00100000:0.0:1788636546.308005:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788636546.308014:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976421248:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636546.308399:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa09050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976421248:12345-0@lo:502:mount.lustre.0 Request processed in 385us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.308408:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788636546.308976:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421248:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788636546.309363:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1788636546.309571:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1788636546.309607:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1788636546.309679:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1788636546.309718:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1788636546.309931:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1788636546.309979:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1788636546.310077:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1788636546.310129:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:1.0:1788636546.310183:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421376:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636546.310315:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636546.310424:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7a402900 going to sleep for 11 seconds 00000100:00100000:3.0:1788636546.311100:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976421376 00000100:00100000:3.0:1788636546.311109:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976421376 00000100:00100000:3.0:1788636546.311211:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788636546.311221:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976421376:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636546.311458:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976421376:12345-0@lo:502:mount.lustre.0 Request processed in 238us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636546.311467:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788636546.311557:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421376:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788636546.311649:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:1.0:1788636546.311661:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788636546.315786:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788636546.315826:0:15866:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788636546.315834:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.315836:0:15866:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788636546.315843:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788636546.315868:0:15866:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cfc439ccd40) 00000020:00000080:1.0:1788636546.315890:0:15866:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788636546.315897:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788636546.315955:0:15866:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd7abc6000 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788636546.315963:0:15866:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788636546.315968:0:15866:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xa6aa59fb12fa850a 00010000:00010000:1.0:1788636546.323227:0:15866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788636546.323839:0:15866:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:1.0:1788636546.326168:0:15866:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788636546.327873:0:15866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788636546.327884:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636546.327890:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.327893:0:15866:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788636546.327896:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636546.327900:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.327901:0:15866:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788636546.327905:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788636546.327907:0:15866:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788636546.327909:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636546.327912:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.327913:0:15866:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788636546.327915:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636546.327918:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.327919:0:15866:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788636546.327923:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788636546.327980:0:15866:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636546.327983:0:15866:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.327985:0:15866:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788636546.327988:0:15866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1788636546.328231:0:15864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1788636546.328267:0:15864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788636546.328291:0:15864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa84f5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa84fc expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636546.328304:0:15864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8196ba00/0xa6aa59fb12fa84f5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa84fc expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636546.328312:0:15864:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd7abc6000 from 1 10000000:01000000:2.0:1788636546.328315:0:15864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636546.328351:0:15864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636546.328358:0:15864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636546.328380:0:15864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636546.328405:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421504:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788636546.328480:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636546.328526:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd44c58f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636546.328740:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976421504 00000100:00100000:1.0:1788636546.328748:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976421504 00000100:00100000:1.0:1788636546.328832:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788636546.328842:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fcbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:15864:x1875520976421504:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788636546.328856:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636546.328869:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa8511 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.328895:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 18 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.328906:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 18 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.328915:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196aa00, rc 0) 00000100:00100000:1.0:1788636546.328955:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fcbb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976421504:12345-0@lo:101:mount.lustre.0 Request processed in 115us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636546.328962:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788636546.329069:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636546.329085:0:15864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.329094:0:15864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636546.329603:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788636546.329959:0:15864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636546.330201:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788636546.330249:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788636546.330314:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788636546.330322:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788636546.330390:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636546.330436:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636546.330489:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976421632 00000100:00100000:3.0:1788636546.330495:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976421632 00000100:00100000:3.0:1788636546.330525:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636546.330533:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fcb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976421632:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636546.330715:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fcb9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976421632:12345-0@lo:501:mount.lustre.0 Request processed in 181us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636546.330722:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788636546.330762:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd58305d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636546.330779:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421632:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636546.330830:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421760:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636546.330867:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636546.330889:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976421760 00000100:00100000:3.0:1788636546.330893:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976421760 00000100:00100000:3.0:1788636546.330910:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636546.330917:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fcbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976421760:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636546.331179:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fcbac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976421760:12345-0@lo:503:mount.lustre.0 Request processed in 261us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636546.331185:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788636546.331212:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd58305d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788636546.331224:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421760:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788636546.331734:0:15864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788636546.331793:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421888:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636546.331859:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636546.331889:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976421888 00000100:00100000:3.0:1788636546.331894:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976421888 00000100:00100000:3.0:1788636546.332773:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788636546.332790:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd766f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976421888:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636546.333125:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd766f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976421888:12345-0@lo:502:mount.lustre.0 Request processed in 337us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636546.333134:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788636546.333298:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd58305d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636546.333320:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976421888:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636546.333716:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1788636546.333775:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1788636546.333866:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1788636546.333907:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1788636546.333938:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1788636546.334023:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1788636546.334085:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1788636546.334174:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1788636546.334218:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422016:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636546.334274:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636546.334310:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976422016 00000100:00100000:2.0:1788636546.334316:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976422016 00000100:00100000:2.0:1788636546.334354:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788636546.334363:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd766f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976422016:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636546.334535:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd766f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976422016:12345-0@lo:502:mount.lustre.0 Request processed in 172us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636546.334543:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788636546.334587:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd44c58600 going to sleep for 11 seconds 00000100:00100000:2.0:1788636546.334604:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422016:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636546.334688:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788636546.334699:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788636546.335922:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636546.335932:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.335935:0:15870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788636546.335942:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd7abc6000 00000020:00000080:1.0:1788636546.335946:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636546.335953:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636546.335956:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.335958:0:15870:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788636546.335962:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636546.335972:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.335974:0:15870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788636546.335978:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cfd7abc6000 00000020:00000080:1.0:1788636546.335981:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636546.336166:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636546.336171:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.336172:0:15870:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788636546.336175:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788636546.336178:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.336180:0:15870:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788636546.336184:0:15870:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cfd7abc6000 00000020:00000080:1.0:1788636546.336186:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788636546.337402:0:15870:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788636546.337409:0:15870:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788636546.337411:0:15870:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788636546.337415:0:15870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788636546.338148:0:15864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788636546.338179:0:15864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788636546.338205:0:15864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.338217:0:15864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788636546.338333:0:15864:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788636546.338336:0:15864:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cfd7abc6000 10000000:01000000:3.0:1788636546.338339:0:15864:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cfd7abc6000 10000000:01000000:3.0:1788636546.338343:0:15864:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788636546.338349:0:15864:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cfd7abc6000 from 1 10000000:01000000:3.0:1788636546.338352:0:15864:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788636546.338388:0:15864:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa851f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.338396:0:15864:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa851f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.338407:0:15864:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa851f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636546.338430:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422144:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788636546.338493:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636546.338549:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd509659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636546.338628:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976422144 00000100:00100000:0.0:1788636546.338637:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976422144 00000100:00100000:0.0:1788636546.338685:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788636546.338695:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd766f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976422144:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788636546.338714:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636546.338728:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191d400/0xa6aa59fb12fa8526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa851f expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636546.338752:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191d400/0xa6aa59fb12fa8526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa851f expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636546.338763:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191d400/0xa6aa59fb12fa8526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa851f expref: 19 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636546.338772:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d400, rc 0) 00000100:00100000:0.0:1788636546.338856:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd766f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422144:12345-0@lo:101:mount.lustre.0 Request processed in 162us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.338864:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788636546.339107:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422144:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788636546.339122:0:15864:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa851f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8526 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.339131:0:15864:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa851f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8526 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636546.341877:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1788636546.343669:0:15864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788636546.346207:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788636546.346363:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788636546.346400:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788636546.346448:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788636546.346484:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788636546.346528:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788636546.346561:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788636546.346591:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788636546.346636:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788636546.346668:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788636546.346695:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788636546.346735:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788636546.346770:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788636546.346843:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788636546.346893:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788636546.346921:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788636546.346946:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788636546.348120:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788636546.348215:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788636546.348336:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788636546.348436:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788636546.348484:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788636546.348541:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788636546.348601:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788636546.349070:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788636546.349123:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788636546.349196:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788636546.349787:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788636546.349879:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788636546.349974:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1788636546.352710:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1788636546.352767:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1788636546.352824:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1788636546.352901:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1788636546.352940:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1788636546.352989:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1788636546.353025:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1788636546.353126:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1788636546.353134:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1788636546.353250:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636546.353312:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636546.353366:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd509659c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636546.353634:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976422272 00000100:00100000:0.0:1788636546.353652:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976422272 00000100:00100000:0.0:1788636546.353703:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788636546.353713:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422272:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788636546.353978:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422272:12345-0@lo:501:mount.lustre.0 Request processed in 266us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.353986:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788636546.354260:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422272:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788636546.354297:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422400:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788636546.354341:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636546.354374:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd509659c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636546.354473:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976422400 00000100:00100000:1.0:1788636546.354478:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976422400 00000100:00100000:1.0:1788636546.354515:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788636546.354524:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422400:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788636546.354837:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422400:12345-0@lo:503:mount.lustre.0 Request processed in 313us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636546.354843:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788636546.355054:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422400:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788636546.355608:0:15864:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788636546.355675:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422528:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788636546.355726:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636546.355843:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636546.357401:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976422528 00000100:00100000:1.0:1788636546.357412:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976422528 00000100:00100000:1.0:1788636546.357466:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788636546.357476:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422528:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788636546.358114:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422528:12345-0@lo:502:mount.lustre.0 Request processed in 637us (2385us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636546.358123:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788636546.358232:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612ca680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422528:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788636546.358571:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788636546.358637:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788636546.358672:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788636546.358721:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788636546.358759:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788636546.359313:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788636546.359358:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788636546.359385:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788636546.359437:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788636546.359469:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788636546.359497:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788636546.359534:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788636546.359575:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788636546.359601:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788636546.359648:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788636546.359687:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788636546.359722:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788636546.359769:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788636546.359841:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788636546.359880:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788636546.359941:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788636546.359981:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788636546.361314:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788636546.361428:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788636546.361473:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788636546.361512:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788636546.361567:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788636546.361608:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788636546.361661:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788636546.361713:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788636546.361753:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788636546.361788:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788636546.362654:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788636546.362719:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788636546.362772:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788636546.362858:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788636546.362899:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788636546.362936:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788636546.362986:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788636546.363035:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788636546.363089:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422656:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788636546.363179:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636546.363225:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f7fa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788636546.365302:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976422656 00000100:00100000:0.0:1788636546.365315:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976422656 00000100:00100000:0.0:1788636546.365370:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788636546.365380:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422656:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788636546.365641:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976422656:12345-0@lo:502:mount.lustre.0 Request processed in 261us (2461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.365659:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788636546.366211:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3aa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976422656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788636546.366339:0:15864:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1788636546.366353:0:15864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1788636546.372656:0:15874:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788636546.372674:0:15874:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cfd48dccd40) 00000020:00000080:2.0:1788636546.372696:0:15874:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1788636546.372783:0:15874:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cfd7abc6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788636546.372787:0:15874:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cfd7abc6000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788636546.372790:0:15874:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cfd7abc6000 3 00010000:00080000:2.0:1788636546.376013:0:15874:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cfd7fcf2800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.157@tcp at head 00010000:00010000:3.0:1788636546.379330:0:15874:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788636546.379550:0:15874:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788636546.379772:0:15874:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788636546.379785:0:15874:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xa6aa59fb12fa8534 00000100:00080000:3.0:1788636546.379920:0:15874:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788636546.379927:0:15874:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cfd7fcf2800 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:3.0:1788636546.379962:0:15874:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd612c8380 x1875520976422784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788636546.380020:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1875520976422784:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788636546.380089:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636546.380231:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976422784 00000100:00100000:0.0:1788636546.380238:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976422784 00000100:00100000:0.0:1788636546.380282:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636546.380289:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3279:x1875520976422784:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788636546.380310:0:14466:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:0.0:1788636546.380338:0:14466:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xa6aa59fb12fa853b 00000004:00100000:0.0:1788636546.380352:0:14466:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788636546.380384:0:14466:0:(import.c:65:import_set_state_nolock()) ffff9cfc42bc7000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788636546.380510:0:15874:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788636546.380607:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3279:x1875520976422784:12345-0@lo:38:llog_process_th.0 Request processed in 316us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.380615:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636546.380694:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976422912:0@lo:400:kworker.0 00000100:00100000:3.0:1788636546.380732:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788636546.380776:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636546.380781:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788636546.380783:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636546.380788:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 414 00000100:00080000:0.0:1788636546.380791:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788636546.380965:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cfd74e13800 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:0.0:1788636546.380985:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd6f6ac000 x1875520976423040/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636546.381055:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976423168:0@lo:400:kworker.0 00000100:00100000:0.0:1788636546.381098:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636546.381120:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636546.381125:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976423296:0@lo:400:kworker.0 00000100:00100000:0.0:1788636546.381156:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636546.381182:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976423168 00000100:00100000:0.0:1788636546.381185:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976423168 00000100:00100000:0.0:1788636546.381214:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976423296 00000100:00100000:0.0:1788636546.381216:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976423296 00000100:00100000:0.0:1788636546.381231:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636546.381238:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976423168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636546.381385:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3280:x1875520976423168:12345-0@lo:400:kworker.0 Request processed in 147us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.381392:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636546.381406:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636546.381412:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976423296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636546.381432:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976423296:12345-0@lo:400:kworker.0 Request processed in 22us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.381438:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788636546.381468:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd6f6ad880 x1875520976423296/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636546.381481:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976423296:0@lo:400:kworker.0 00010000:00080000:0.0:1788636546.381489:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd6f6aea00 x1875520976423168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636546.381497:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3280:1875520976423168:0@lo:400:kworker.0 00010000:00080000:1.0:1788636546.381595:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cfd612c8380 x1875520976422784/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788636556 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636546.381604:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636546.381611:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1788636546.381618:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788636546.381622:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788636546.381625:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd7fcf2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788636546.381631:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3279:1875520976422784:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788636546.381643:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976423040:0@lo:8:kworker.0 00000100:00100000:1.0:1788636546.381666:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636546.381824:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976422912 00000100:00100000:0.0:1788636546.381833:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976422912 00000100:00100000:0.0:1788636546.381853:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976423040 00000100:00100000:0.0:1788636546.381856:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976423040 00000100:00100000:0.0:1788636546.381865:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788636546.381870:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1875520976422912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788636546.381925:0:15148:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788636546.381932:0:15148:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788636546.381987:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636546.381993:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3279:x1875520976423040:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788636546.382047:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3279:x1875520976423040:12345-0@lo:8:kworker.0 Request processed in 52us (378us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788636546.382054:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636546.382077:0:3279:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788636546.382081:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788636546.382085:0:3279:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788636546.382087:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976423040:0@lo:8:kworker.0 00000100:00100000:0.0:1788636546.382324:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612ca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3283:x1875520976422912:12345-0@lo:400:kworker.0 Request processed in 453us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636546.382331:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:1.0:1788636546.382511:0:15874:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788636546.382562:0:15864:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788636546.382585:0:15864:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788636546.382604:0:15864:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa851f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8526 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.382614:0:15864:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d800/0xa6aa59fb12fa851f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8526 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788636546.382654:0:15864:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788636546.382656:0:15864:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788636546.382657:0:15864:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636546.382658:0:15864:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636546.382660:0:15864:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636546.382661:0:15864:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636546.382663:0:15864:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636546.382664:0:15864:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636546.382665:0:15864:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788636546.382668:0:15864:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788636546.382671:0:15864:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788636546.382672:0:15864:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788636546.382673:0:15864:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788636546.382674:0:15864:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788636546.382675:0:15864:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788636546.382676:0:15864:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788636546.382677:0:15864:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788636546.382678:0:15864:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788636546.382679:0:15864:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788636546.382695:0:15864:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788636546.382706:0:15864:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976423424:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788636546.382740:0:15864:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636546.382766:0:15864:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7a4026c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636546.382783:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976423424 00000100:00100000:1.0:1788636546.382786:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976423424 00000100:00100000:1.0:1788636546.382840:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788636546.382847:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:15864:x1875520976423424:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788636546.382876:0:14457:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788636546.382891:0:14457:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788636546.386156:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976422912:0@lo:400:kworker.0 20000000:01000000:2.0:1788636546.406861:0:14457:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788636546.406876:0:14457:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788636546.406909:0:14480:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788636546.406913:0:14480:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788636546.406934:0:14480:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636546.406952:0:14480:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636546.406961:0:14480:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636546.406997:0:14480:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636546.407167:0:14480:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 19 pid: 14459 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636546.407183:0:14480:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875520976423552:0@lo:104: 00000100:00100000:2.0:1788636546.407309:0:14480:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636546.407387:0:14480:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d281cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788636546.409183:0:14447:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976423552 00000100:00100000:1.0:1788636546.409194:0:14447:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976423552 00000100:00100000:1.0:1788636546.409258:0:14447:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636546.409268:0:14447:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:14480:x1875520976423552:12345-0@lo:104: 00010000:00010000:1.0:1788636546.409286:0:14447:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409374:0:14447:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788636546.409381:0:14447:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:14480:x1875520976423552:12345-0@lo:104: Request processed in 116us (2073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636546.409389:0:14447:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788636546.409410:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636546.409416:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409424:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191d000 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636546.409429:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409438:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636546.409446:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636546.409452:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788636546.409485:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409492:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636546.409526:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409534:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd8191d000/0xa6aa59fb12fa840e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8415 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409553:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636546.409555:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636546.409557:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636546.409580:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976423680:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636546.409617:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636546.409660:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976423680 00000100:00100000:1.0:1788636546.409664:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976423680 00010000:00010000:1.0:1788636546.409684:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 20 pid: 14459 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636546.409709:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636546.409716:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+20:3282:x1875520976423680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636546.409728:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636546.409733:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 20 pid: 14459 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409744:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 20 pid: 14459 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409761:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409769:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788636546.409818:0:14451:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002881052s 00010000:00010000:1.0:1788636546.409824:0:14451:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409832:0:14451:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409839:0:14451:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409845:0:14451:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409851:0:14451:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c1000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636546.409856:0:14451:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409864:0:14451:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409873:0:14451:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636546.409883:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636546.409914:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+20:3282:x1875520976423680:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636546.409922:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788636546.409958:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976423680:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788636546.410177:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd6f4eb400/0xa6aa59fb12fa8415 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa840e expref: 19 pid: 14459 timeout: 515 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636546.410189:0:14480:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14480:1875520976423552:0@lo:104: 00010000:00010000:3.0:1788636546.410207:0:14480:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.410217:0:14480:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.410223:0:14480:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636546.410230:0:14480:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd699c1000/0xa6aa59fb12fa8542 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14480 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636546.416394:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:15864:x1875520976423424:12345-0@lo:253:mount.lustre.0 Request processed in 33538us (33644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636546.416421:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788636546.416564:0:15864:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:c8fa81e7-22d5-4023-a9dc-119f1fc21189:15864:1875520976423424:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788636546.416580:0:15864:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1788636546.416584:0:15864:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788636546.416585:0:15864:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788636546.416587:0:15864:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788636546.416588:0:15864:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788636546.416589:0:15864:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788636546.416590:0:15864:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788636546.416592:0:15864:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788636546.416594:0:15864:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788636546.416595:0:15864:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788636546.416609:0:15864:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788636546.422704:0:15864:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636546.422939:0:15864:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788636546.423183:0:15864:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636546.423426:0:15864:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788636546.423612:0:15864:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788636546.423975:0:15864:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788636546.424645:0:15864:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788636546.464193:0:15864:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1788636546.464203:0:15864:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1788636546.464237:0:15864:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788636546.464442:0:15864:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.157@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788636546.464456:0:15864:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1788636546.464482:0:15864:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788636546.626672:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636547.647242:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788636547.774986:0:14461:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788636547.774994:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cfd610d7000 from 8 10000000:01000000:1.0:1788636547.775000:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788636547.775048:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b400/0xa6aa59fb12fa8549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636547.775060:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b400/0xa6aa59fb12fa8549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636547.775072:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b400/0xa6aa59fb12fa8549 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636547.775097:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976423808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788636547.775184:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636547.775233:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd759326c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636547.775289:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976423808 00000100:00100000:3.0:1788636547.775297:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976423808 00000100:00100000:3.0:1788636547.775351:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788636547.775360:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:14461:x1875520976423808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788636547.775372:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636547.775386:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd5997c600/0xa6aa59fb12fa8550 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa8549 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636547.775410:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd5997c600/0xa6aa59fb12fa8550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8549 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636547.775420:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd5997c600/0xa6aa59fb12fa8550 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8549 expref: 19 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636547.775429:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd5997c600, rc 0) 00000100:00100000:3.0:1788636547.775480:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:14461:x1875520976423808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636547.775487:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788636547.775574:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976423808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636547.775588:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b400/0xa6aa59fb12fa8549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8550 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636547.775597:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b400/0xa6aa59fb12fa8549 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa8550 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636547.775651:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976423936:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788636547.775682:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636547.775707:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd6f4c13c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636547.775760:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976423936 00000100:00100000:3.0:1788636547.775764:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976423936 00000100:00100000:3.0:1788636547.775821:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788636547.775836:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:14461:x1875520976423936:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788636547.775851:0:14457:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788636547.775866:0:14457:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788636547.775869:0:14457:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788636547.775946:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:14461:x1875520976423936:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636547.775953:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788636547.775986:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976423936:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788636547.776037:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788636547.776044:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b400/0xa6aa59fb12fa8549 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8550 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636547.776052:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b400/0xa6aa59fb12fa8549 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa8550 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636548.346536:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:1.0:1788636548.346554:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:2.0:1788636548.671557:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636549.695932:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636550.273731:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976424064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636550.273825:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636550.273967:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976424064 00000100:00100000:3.0:1788636550.273975:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976424064 00000100:00100000:3.0:1788636550.274041:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636550.274050:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976424064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788636550.274083:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636550.274141:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976424064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636550.274149:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788636550.274211:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636550.274241:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788636550.274264:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976424064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788636550.718978:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636551.742951:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788636551.809917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788636551.809924:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788636551.809928:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788636551.809940:0:37:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cfd74e13800 using connection 192.168.203.157@tcp/0@lo 00000100:00100000:0.0:1788636551.809972:0:37:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cfd6f6af480 x1875520976424448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788636551.810096:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976424192:0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810180:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.810225:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976424832:0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810256:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.810280:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788636551.810286:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976424320:0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810312:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.810343:0:3279:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976424448:0@lo:8:kworker.0 00000100:00100000:0.0:1788636551.810368:0:3279:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.810404:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976424576:0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810430:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.810452:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636551.810458:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976424704:0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810481:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.810519:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976424192 00000100:00100000:0.0:1788636551.810526:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976424192 00000100:00100000:0.0:1788636551.810572:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636551.810581:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3280:x1875520976424192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810631:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3280:x1875520976424192:12345-0@lo:400:kworker.0 Request processed in 50us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636551.810639:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788636551.810676:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976424832 00000100:00100000:0.0:1788636551.810681:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976424832 00000100:00100000:0.0:1788636551.810723:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976424576 00000100:00100000:0.0:1788636551.810727:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976424576 00000100:00100000:0.0:1788636551.810741:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976424704 00000100:00100000:0.0:1788636551.810744:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976424704 00000100:00100000:0.0:1788636551.810762:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636551.810769:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976424832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810831:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976424832:12345-0@lo:400:kworker.0 Request processed in 63us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636551.810839:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636551.810854:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636551.810860:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976424576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810898:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976424576:12345-0@lo:400:kworker.0 Request processed in 38us (467us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636551.810903:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788636551.810915:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636551.810921:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976424704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.810948:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976424704:12345-0@lo:400:kworker.0 Request processed in 27us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636551.810953:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788636551.810971:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976424320 00000100:00100000:0.0:1788636551.810975:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976424320 00000100:00100000:0.0:1788636551.810996:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976424448 00000100:00100000:0.0:1788636551.810999:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976424448 00000100:00100000:0.0:1788636551.811022:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788636551.811030:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976424320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636551.811036:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636551.811045:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3279:x1875520976424448:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788636551.811065:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976424320:12345-0@lo:400:kworker.0 Request processed in 35us (751us total) trans 0 rc 0/0 00010000:00080000:2.0:1788636551.811073:0:15145:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 420 last 0 00000100:00100000:0.0:1788636551.811089:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000020:00000080:2.0:1788636551.811119:0:15145:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xa6aa59fb12fa8557 00002000:00100000:2.0:1788636551.811134:0:15145:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cfd58a90800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00080000:0.0:1788636551.811134:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00080000:2.0:1788636551.811141:0:15145:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788636551.811144:0:15145:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788636551.811510:0:15145:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788636551.811543:0:15145:0:(import.c:65:import_set_state_nolock()) ffff9cfd58a96800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636551.811594:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3279:x1875520976424448:12345-0@lo:8:kworker.0 Request processed in 548us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636551.811602:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788636551.811679:0:3279:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f6af480 x1875520976424448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788636576 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788636551.811697:0:3279:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788636551.811706:0:3279:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788636551.811713:0:3279:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788636551.811715:0:3279:0:(import.c:65:import_set_state_nolock()) ffff9cfd74e13800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788636551.811732:0:3279:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788636551.811738:0:3279:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3279:1875520976424448:0@lo:8:kworker.0 00000004:00080000:0.0:1788636551.811860:0:14489:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788636551.811889:0:14489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1875520976425088:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788636551.811926:0:14489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.811947:0:14489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d288f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636551.812001:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976424960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636551.812030:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.812067:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976424960 00000100:00100000:0.0:1788636551.812073:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976424960 00000100:00100000:0.0:1788636551.812126:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788636551.812135:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875520976424960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636551.812160:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636551.812249:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3281:x1875520976424960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (217us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636551.812256:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788636551.812275:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788636551.812303:0:3281:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f6af480 x1875520976424960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788636567 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636551.812318:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976424960:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788636551.812346:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f6aea00 x1875520976424704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636551.812356:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976424704:0@lo:400:kworker.0 00010000:00080000:0.0:1788636551.812367:0:3282:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f6adc00 x1875520976424576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788636551.812376:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976424576:0@lo:400:kworker.0 00000100:00100000:0.0:1788636551.812397:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976425088 00000100:00100000:0.0:1788636551.812401:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976425088 00000100:00100000:0.0:1788636551.812425:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636551.812431:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14489:x1875520976425088:12345-0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788636551.812850:0:14488:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788636551.813246:0:14488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 420837449081ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788636551.813427:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976424320:0@lo:400:kworker.0 00000100:00100000:1.0:1788636551.813441:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976424192:0@lo:400:kworker.0 00010000:00080000:1.0:1788636551.813455:0:3280:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cfd6f6af100 x1875520976424832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788636567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788636551.813464:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976424832:0@lo:400:kworker.0 00002000:00080000:1.0:1788636551.833464:0:15148:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788636551.833476:0:15148:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788636551.833482:0:15148:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788636551.857439:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788636551.857450:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.857467:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788636551.857471:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636551.857478:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.857495:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.857505:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.857512:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.857551:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.857680:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.857688:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.857722:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.857727:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.857737:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.857758:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.857765:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058407b9a/0xa6aa59fb12fa855e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.857788:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.857790:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.857809:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788636551.858288:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788636551.858295:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858303:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788636551.858306:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636551.858309:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858318:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858325:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858333:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858347:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636551.858356:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636551.858360:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858367:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ae00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636551.858376:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858385:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858397:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858403:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8565 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858416:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636551.858418:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636551.858420:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788636551.858853:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788636551.858860:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858869:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788636551.858872:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636551.858876:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858887:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858896:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858910:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.858932:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.859134:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.859140:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.859149:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.859153:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.859163:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.859185:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.859192:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002c6e9f70/0xa6aa59fb12fa856c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.859206:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.859208:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.859210:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788636551.859352:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788636551.859358:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859368:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788636551.859372:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636551.859375:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859385:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859393:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859399:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859413:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636551.859422:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636551.859426:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859440:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636551.859443:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859451:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859462:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859469:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8573 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859483:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636551.859484:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636551.859486:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788636551.859895:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788636551.859901:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859909:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788636551.859913:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636551.859917:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859926:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859940:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859947:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.859963:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.862366:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.862382:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.862397:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196be00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.862402:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.862412:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.862430:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.862438:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009613b467/0xa6aa59fb12fa857a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.862475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.862477:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.862479:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788636551.868239:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788636551.868254:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868271:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788636551.868276:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636551.868283:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868297:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868309:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868317:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868385:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788636551.868914:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788636551.868921:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868930:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=420s v=(0 0) 00010000:00010000:1.0:1788636551.868933:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636551.868937:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868946:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868953:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.868959:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.877127:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636551.877143:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.877158:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636551.877164:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.877174:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.877201:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.877209:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d9a4531/0xa6aa59fb12fa8581 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.877832:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788636551.877870:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636551.877875:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.877882:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196ae00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636551.877894:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.877903:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.877915:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.877921:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000af86b797/0xa6aa59fb12fa8588 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636551.877936:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636551.877937:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636551.877939:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636551.878123:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.881018:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.881029:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881045:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.881050:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.881056:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881070:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881079:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881087:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881123:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636551.881519:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.881525:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881543:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.881546:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.881550:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881559:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881566:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881574:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881594:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788636551.881609:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788636551.881614:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881621:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.881626:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881634:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881660:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881668:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa858f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881687:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.881691:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881697:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.881701:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881708:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881718:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881724:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa8596 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.881735:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.881737:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.881744:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636551.883520:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.884593:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.884606:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.884623:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.884627:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.886158:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886183:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886196:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886215:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886245:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636551.886879:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.886888:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886900:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.886904:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.886909:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886930:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886940:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886948:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886968:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788636551.886986:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788636551.886991:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.886999:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c400 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.887004:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.887014:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.887031:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.887039:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa859d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.887063:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.887066:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.887073:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.887076:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.887084:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.887094:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.887394:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.888542:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.888569:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.888572:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.888575:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.891549:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.891562:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891581:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.891594:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.891602:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891616:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891628:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891637:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891655:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.891669:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.891675:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891683:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.891688:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891697:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891723:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891743:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.891763:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.891765:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.891767:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.893418:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.893429:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893445:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.893449:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.893455:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893467:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893477:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893485:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893505:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.893517:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.893528:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893535:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fda00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.893539:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893548:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893562:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893569:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f32155eb/0xa6aa59fb12fa85b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.893584:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.893586:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.893588:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.894016:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.894022:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894030:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.894034:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.894038:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894057:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894065:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894073:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894087:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.894094:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.894109:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894116:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.894119:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894127:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894137:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894144:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb2246cc/0xa6aa59fb12fa85b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894162:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.894164:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.894165:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.894753:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.894761:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894770:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.894774:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.894779:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894790:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894816:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894824:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894837:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.894846:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.894850:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894866:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fdc00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.894870:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894878:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894902:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894909:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075b28ddd/0xa6aa59fb12fa85c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.894922:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.894923:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.894925:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.895296:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.895302:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895310:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.895313:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.895318:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895327:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895340:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895347:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895360:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.895367:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.895371:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895378:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.895382:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895389:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895399:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895406:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f42dd8dc/0xa6aa59fb12fa85c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895418:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.895423:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.895425:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.895832:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.895838:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895846:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.895849:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.895854:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895862:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895871:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895878:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895889:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788636551.895896:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.895901:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895907:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fd800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.895911:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895930:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895941:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895949:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005ebeafef/0xa6aa59fb12fa85ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.895962:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.895964:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.895965:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788636551.896469:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788636551.896487:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.896494:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.896504:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.896507:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.896512:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.896522:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.896530:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.896543:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.896567:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788636551.897305:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636551.897312:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.897331:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636551.897335:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.897343:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.897356:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.897363:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079df4493/0xa6aa59fb12fa85d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.897380:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636551.897382:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636551.897383:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.897451:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.897457:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.897465:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.897468:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.897473:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.897482:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.897489:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.897495:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.897543:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636551.897986:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.897992:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.898005:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.898008:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.898012:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.898022:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.898029:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.898037:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.902914:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788636551.902931:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.902947:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c400 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636551.902952:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.902965:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.903005:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.903014:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1a21bd4/0xa6aa59fb12fa85dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.903043:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636551.903048:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.903055:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636551.903058:0:14453:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.903066:0:14453:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.903076:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.903083:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636551.903085:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636551.903087:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.905012:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788636551.905023:0:15148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057e52519/0xa6aa59fb12fa85e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636551.905292:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.907324:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.907337:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907353:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.907357:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.907362:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907388:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907399:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907409:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907430:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636551.907933:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.907939:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907947:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.907950:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.907954:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907963:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907970:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.907984:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908002:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788636551.908016:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788636551.908022:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908029:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997c000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.908033:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908041:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908056:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908063:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000990df8b2/0xa6aa59fb12fa85ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908077:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788636551.908080:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908093:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997de00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636551.908096:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908116:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908125:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908131:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092b7d6eb/0xa6aa59fb12fa85f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908143:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.908144:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.908145:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.908527:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.908533:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908541:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.908544:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.908549:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908557:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908570:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908578:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.908598:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636551.908887:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636551.908894:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.908901:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd820fc800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636551.908904:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.908912:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.908925:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.908939:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d425620/0xa6aa59fb12fa85f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.908957:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636551.908959:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636551.908961:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636551.909033:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.909083:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.909089:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909105:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.909109:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.909114:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909123:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909131:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909137:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909171:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788636551.909592:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.909597:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909606:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.909609:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.909613:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909623:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909631:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909638:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.909659:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788636551.910094:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788636551.910458:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788636551.910465:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910474:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41991600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636551.910478:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910486:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910502:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910509:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a2309b4/0xa6aa59fb12fa85ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910525:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636551.910528:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910541:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41991e00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636551.910545:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910552:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910560:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910567:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8b053b9/0xa6aa59fb12fa8606 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.910578:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636551.910580:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636551.910581:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788636551.910779:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.910791:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.910827:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.910834:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.910845:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.910854:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.910861:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.910877:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788636551.911306:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636551.911311:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.911320:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41991000 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636551.911323:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.911334:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.911353:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.911360:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007a9a12e6/0xa6aa59fb12fa860d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.911376:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636551.911378:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636551.911380:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788636551.911661:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788636551.911667:0:15148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.911676:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=420s v=(0 0) 00010000:00010000:3.0:1788636551.911679:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636551.911684:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.911693:0:15148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.911700:0:15148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.911713:0:15148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636551.911733:0:15148:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788636551.911944:0:15148:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788636551.912040:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14489:x1875520976425088:12345-0@lo:5:osp-pre-1-0.0 Request processed in 99606us (100111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636551.912050:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636551.912171:0:14489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1875520976425088:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788636551.912188:0:14489:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:0.0:1788636551.912245:0:14489:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1875520976425216:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788636551.912280:0:14489:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636551.912330:0:14489:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d288f00 going to sleep for 11 seconds 00010000:00010000:0.0:1788636551.912343:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788636551.912348:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.912357:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41991400 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636551.912360:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.912369:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.912396:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.912403:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087716cb6/0xa6aa59fb12fa8614 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636551.912420:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636551.912422:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636551.912424:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636551.912533:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976425216 00000100:00100000:3.0:1788636551.912540:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976425216 00000100:00100000:3.0:1788636551.912592:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788636551.912602:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14489:x1875520976425216:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788636551.912641:0:15145:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:2.0:1788636551.913325:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636551.921333:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14489:x1875520976425216:12345-0@lo:5:osp-pre-1-0.0 Request processed in 8724us (9044us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788636551.921347:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788636551.921502:0:14489:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c58000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14489:1875520976425216:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788636551.921520:0:14489:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000040:00080000:2.0:1788636552.127483:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:0.0:1788636552.415154:0:16224:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg357-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788636552.769733:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636553.791185:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636554.662070:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636554.662613:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963846144 00000100:00100000:1.0:1788636554.662625:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963846144 00000100:00100000:1.0:1788636554.662679:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 75 00000100:00100000:1.0:1788636554.662688:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2359:x1875520963846144:12345-192.168.203.57@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788636554.662844:0:14459:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 41e3de15-0175-4e7c-8623-04ef993a057c@192.168.203.57@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:1.0:1788636554.662874:0:14459:0:(genops.c:1385:class_connect()) connect: client 41e3de15-0175-4e7c-8623-04ef993a057c, cookie 0xa6aa59fb12fa861b 00000100:00080000:1.0:1788636554.663008:0:14459:0:(import.c:65:import_set_state_nolock()) ffff9cfc43a04000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636554.663100:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+5:2359:x1875520963846144:12345-192.168.203.57@tcp:250:mount.lustre.0 Request processed in 409us (1037us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636554.663676:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 75 00000100:00100000:2.0:1788636554.685195:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.685289:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963846272 00000100:00100000:0.0:1788636554.685298:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963846272 00000100:00100000:0.0:1788636554.685352:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 76 00000100:00100000:0.0:1788636554.685363:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+5:13774:x1875520963846272:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636554.685378:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636554.685581:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191cc00/0xa6aa59fb12fa8622 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351558ee expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636554.685613:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191cc00/0xa6aa59fb12fa8622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558ee expref: 6 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636554.685625:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191cc00/0xa6aa59fb12fa8622 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558ee expref: 6 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636554.685634:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191cc00, rc 0) 00000100:00100000:0.0:1788636554.685706:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+6:13774:x1875520963846272:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 345us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.685713:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 76 00000100:00100000:2.0:1788636554.687692:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636554.687785:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963846400 00000100:00100000:1.0:1788636554.687859:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963846400 00000100:00100000:1.0:1788636554.687912:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 77 00000100:00100000:1.0:1788636554.687922:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+6:13774:x1875520963846400:12345-192.168.203.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788636554.688191:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+6:13774:x1875520963846400:12345-192.168.203.57@tcp:501:mount.lustre.0 Request processed in 269us (506us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788636554.688847:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 77 00000100:00100000:2.0:1788636554.700235:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.700361:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963846528 00000100:00100000:0.0:1788636554.700371:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963846528 00000100:00100000:0.0:1788636554.700426:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 78 00000100:00100000:0.0:1788636554.700436:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+6:13774:x1875520963846528:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636554.700451:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636554.700469:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191d000/0xa6aa59fb12fa8629 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351558f5 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636554.700501:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191d000/0xa6aa59fb12fa8629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558f5 expref: 7 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636554.700514:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191d000/0xa6aa59fb12fa8629 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351558f5 expref: 7 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636554.700523:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191d000, rc 0) 00000100:00100000:0.0:1788636554.700572:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+7:13774:x1875520963846528:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 138us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.700578:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 78 00000100:00100000:0.0:1788636554.715585:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636554.715708:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963846656 00000100:00100000:1.0:1788636554.715719:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963846656 00000100:00100000:1.0:1788636554.715782:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 79 00000100:00100000:1.0:1788636554.715793:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+7:13774:x1875520963846656:12345-192.168.203.57@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788636554.716112:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fe65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+8:13774:x1875520963846656:12345-192.168.203.57@tcp:501:mount.lustre.0 Request processed in 320us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636554.716121:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 79 00000100:00100000:2.0:1788636554.718963:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636554.719048:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963846784 00000100:00100000:3.0:1788636554.719058:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963846784 00000100:00100000:3.0:1788636554.719123:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 80 00000100:00100000:3.0:1788636554.719133:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+8:13774:x1875520963846784:12345-192.168.203.57@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788636554.719421:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+8:13774:x1875520963846784:12345-192.168.203.57@tcp:503:mount.lustre.0 Request processed in 287us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636554.719430:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 80 00000100:00100000:2.0:1788636554.743669:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.744318:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963846912 00000100:00100000:0.0:1788636554.744328:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963846912 00000100:00100000:3.0:1788636554.744516:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 81 00000100:00100000:3.0:1788636554.744530:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+8:13793:x1875520963846912:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788636554.744871:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+8:13793:x1875520963846912:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 344us (1209us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636554.744879:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 81 00000100:00100000:1.0:1788636554.764677:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.764886:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963847040 00000100:00100000:0.0:1788636554.764897:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963847040 00000100:00100000:0.0:1788636554.764954:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 82 00000100:00100000:0.0:1788636554.764964:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+8:13793:x1875520963847040:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636554.765293:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+8:13793:x1875520963847040:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 329us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.765301:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 82 00000100:00100000:2.0:1788636554.771311:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636554.771644:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963847168 00000100:00100000:3.0:1788636554.771655:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963847168 00000100:00100000:3.0:1788636554.771712:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 83 00000100:00100000:3.0:1788636554.771723:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+8:13774:x1875520963847168:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788636554.771740:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636554.771757:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfc41991200/0xa6aa59fb12fa8630 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb98284483515591f expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636554.771783:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfc41991200/0xa6aa59fb12fa8630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515591f expref: 9 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636554.771993:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfc41991200/0xa6aa59fb12fa8630 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb98284483515591f expref: 9 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636554.772006:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfc41991200, rc 0) 00000100:00100000:2.0:1788636554.772342:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+9:13774:x1875520963847168:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 619us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636554.772350:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 83 00000100:00100000:3.0:1788636554.777273:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636554.777422:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963847296 00000100:00100000:2.0:1788636554.777432:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963847296 00000100:00100000:2.0:1788636554.777490:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:2.0:1788636554.777500:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+9:13774:x1875520963847296:12345-192.168.203.57@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788636554.777523:0:14458:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788636554.777548:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788636554.777580:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788636554.777584:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788636554.777586:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1788636554.780204:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+9:13774:x1875520963847296:12345-192.168.203.57@tcp:256:mount.lustre.0 Request processed in 2686us (2919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636554.780221:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 84 00000100:00100000:1.0:1788636554.783574:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636554.783667:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963847424 00000100:00100000:2.0:1788636554.783676:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963847424 00000100:00100000:2.0:1788636554.783741:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 85 00000100:00100000:2.0:1788636554.783751:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+9:13774:x1875520963847424:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788636554.783779:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636554.783819:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155926 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636554.783847:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 10 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636554.783859:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 10 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636554.783868:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c0000, rc 0) 00000100:00100000:2.0:1788636554.784025:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+10:13774:x1875520963847424:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 274us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636554.784033:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 85 00000100:00100000:2.0:1788636554.787782:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.787906:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963847552 00000100:00100000:0.0:1788636554.787916:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963847552 00000100:00100000:0.0:1788636554.787980:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 86 00000100:00100000:0.0:1788636554.787990:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+10:13774:x1875520963847552:12345-192.168.203.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788636554.788313:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+10:13774:x1875520963847552:12345-192.168.203.57@tcp:501:mount.lustre.0 Request processed in 323us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.788322:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 86 00000100:00100000:1.0:1788636554.791471:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636554.791594:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963847680 00000100:00100000:2.0:1788636554.791604:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963847680 00000100:00100000:2.0:1788636554.791666:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 87 00000100:00100000:2.0:1788636554.791677:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+10:13774:x1875520963847680:12345-192.168.203.57@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788636554.791994:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+10:13774:x1875520963847680:12345-192.168.203.57@tcp:503:mount.lustre.0 Request processed in 318us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636554.792003:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 87 00000100:00100000:2.0:1788636554.796830:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636554.797630:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963847808 00000100:00100000:1.0:1788636554.797655:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963847808 00000100:00100000:1.0:1788636554.797716:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 88 00000100:00100000:1.0:1788636554.797727:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+10:13798:x1875520963847808:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788636554.798046:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+10:13798:x1875520963847808:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 319us (1250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636554.798065:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 88 00000100:00100000:3.0:1788636554.808840:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.808974:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963847936 00000100:00100000:0.0:1788636554.808983:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963847936 00000100:00100000:0.0:1788636554.809046:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 89 00000100:00100000:0.0:1788636554.809057:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+10:13798:x1875520963847936:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636554.809313:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+10:13798:x1875520963847936:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 256us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.809322:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 89 00000100:00100000:3.0:1788636554.815150:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.816175:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963848064 00000100:00100000:0.0:1788636554.816195:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963848064 00000100:00100000:0.0:1788636554.816246:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:0.0:1788636554.816254:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2359:x1875520963848064:12345-192.168.203.57@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788636554.816282:0:14465:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4a21948e-2331-47c0-8be3-5e0fad8d2f7a@192.168.203.57@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:0.0:1788636554.816326:0:14465:0:(genops.c:1385:class_connect()) connect: client 4a21948e-2331-47c0-8be3-5e0fad8d2f7a, cookie 0xa6aa59fb12fa863e 00000004:00100000:0.0:1788636554.816364:0:14465:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1788636554.816382:0:14465:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788636554.819770:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788636554.850878:0:14465:0:(import.c:65:import_set_state_nolock()) ffff9cfc42bc0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636554.850969:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2359:x1875520963848064:12345-192.168.203.57@tcp:38:mount.lustre.0 Request processed in 34712us (35826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.850980:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:2.0:1788636554.858536:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.858610:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963848320 00000100:00100000:0.0:1788636554.858620:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963848320 00000100:00100000:0.0:1788636554.858741:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:0.0:1788636554.858753:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13774:x1875520963848320:12345-192.168.203.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788636554.858821:0:14464:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788636554.858912:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13774:x1875520963848320:12345-192.168.203.57@tcp:41:mount.lustre.0 Request processed in 161us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.858919:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00080000:2.0:1788636554.859583:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636554.863343:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.863673:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963848192 00000100:00100000:0.0:1788636554.863682:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963848192 00000100:00100000:0.0:1788636554.863738:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:0.0:1788636554.863748:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:0:x1875520963848192:12345-192.168.203.57@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788636554.863775:0:14465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788636554.864451:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:0:x1875520963848192:12345-192.168.203.57@tcp:41:mount.lustre.0 Request processed in 701us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.864460:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:1.0:1788636554.866424:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636554.866621:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963848448 00000100:00100000:3.0:1788636554.866631:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963848448 00000100:00100000:3.0:1788636554.866744:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:3.0:1788636554.866756:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13774:x1875520963848448:12345-192.168.203.57@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788636554.866888:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13774:x1875520963848448:12345-192.168.203.57@tcp:40:mount.lustre.0 Request processed in 133us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636554.866915:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:1.0:1788636554.870001:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.870115:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963848576 00000100:00100000:0.0:1788636554.870124:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963848576 00000100:00100000:0.0:1788636554.870170:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:0.0:1788636554.870178:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2359:x1875520963848576:12345-192.168.203.57@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788636554.870227:0:15146:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4a21948e-2331-47c0-8be3-5e0fad8d2f7a@192.168.203.57@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:0.0:1788636554.870268:0:15146:0:(genops.c:1385:class_connect()) connect: client 4a21948e-2331-47c0-8be3-5e0fad8d2f7a, cookie 0xa6aa59fb12fa8645 00002000:00100000:0.0:1788636554.870279:0:15146:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4a21948e-2331-47c0-8be3-5e0fad8d2f7a/ffff9cfc42bc1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788636554.870303:0:15146:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788636554.870623:0:15146:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788636554.870651:0:15146:0:(import.c:65:import_set_state_nolock()) ffff9cfc42bc4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788636554.870719:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2359:x1875520963848576:12345-192.168.203.57@tcp:8:mount.lustre.0 Request processed in 540us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636554.870726:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:0.0:1788636554.871750:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636554.871790:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636554.871857:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963848832 00000100:00100000:3.0:1788636554.871866:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963848832 00000100:00100000:1.0:1788636554.871895:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963848704 00000100:00100000:1.0:1788636554.871901:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963848704 00000100:00100000:3.0:1788636554.871907:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:3.0:1788636554.871918:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13774:x1875520963848832:12345-192.168.203.57@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788636554.871940:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:1.0:1788636554.871947:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1875520963848704:12345-192.168.203.57@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788636554.871970:0:15876:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4a21948e-2331-47c0-8be3-5e0fad8d2f7a@192.168.203.57@tcp t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:1.0:1788636554.871998:0:15876:0:(genops.c:1385:class_connect()) connect: client 4a21948e-2331-47c0-8be3-5e0fad8d2f7a, cookie 0xa6aa59fb12fa864c 00002000:00100000:1.0:1788636554.872009:0:15876:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4a21948e-2331-47c0-8be3-5e0fad8d2f7a/ffff9cfc43a03000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788636554.872042:0:15876:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788636554.872266:0:15876:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788636554.872293:0:15876:0:(import.c:65:import_set_state_nolock()) ffff9cfc43a06000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636554.872727:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2359:x1875520963848704:12345-192.168.203.57@tcp:8:mount.lustre.0 Request processed in 777us (935us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636554.872736:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00000004:00080000:1.0:1788636554.875019:0:14467:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3028us 00000004:00200000:1.0:1788636554.889777:0:14467:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788636554.889930:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13774:x1875520963848832:12345-192.168.203.57@tcp:33:mount.lustre.0 Request processed in 18008us (18178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636554.889946:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:0.0:1788636555.106345:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636555.109940:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963848960 00000100:00100000:2.0:1788636555.109966:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963848960 00000100:00100000:2.0:1788636555.110053:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:2.0:1788636555.110064:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13819:x1875520963848960:12345-192.168.203.57@tcp:101:mkdir.0 00010000:00010000:2.0:1788636555.110094:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636555.110118:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1200/0xa6aa59fb12fa8653 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155950 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.110182:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa865a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.110196:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa865a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.110210:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa865a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636555.110245:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788636555.110249:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636555.110285:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa865a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.110308:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1200/0xa6aa59fb12fa8653 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155950 expref: 8 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.110325:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa865a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155950 expref: 7 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636555.110333:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd52141100) 00010000:00010000:2.0:1788636555.110336:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636555.110339:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c0c00, rc 0) 00000100:00100000:2.0:1788636555.110409:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:13819:x1875520963848960:12345-192.168.203.57@tcp:101:mkdir.0 Request processed in 347us (4073us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636555.110416:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:1.0:1788636555.391210:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788636555.391232:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976425344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636555.391317:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636555.392007:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976425344 00000100:00100000:0.0:1788636555.392018:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976425344 00000100:00100000:0.0:1788636555.392101:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788636555.392112:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976425344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636555.392137:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788636555.392168:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636555.392192:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976425344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636555.392199:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788636555.392219:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976425344:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788636555.839008:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636556.863116:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636556.929684:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636556.929705:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976425472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636556.929771:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636556.929895:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976425472 00000100:00100000:1.0:1788636556.929902:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976425472 00000100:00100000:1.0:1788636556.929955:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636556.929965:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976425472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788636556.929998:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636556.930051:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3282:x1875520976425472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636556.930058:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788636556.930089:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788636556.930118:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976425472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636556.938186:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976425600:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938253:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636556.938290:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976426112:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938322:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636556.938347:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636556.938353:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976425728:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938377:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636556.938402:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976425856:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938424:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636556.938441:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788636556.938446:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976425984:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938469:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636556.938496:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976425600 00000100:00100000:2.0:1788636556.938503:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976425600 00000100:00100000:2.0:1788636556.938545:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788636556.938553:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd74dfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3280:x1875520976425600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938600:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd74dfdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3280:x1875520976425600:12345-0@lo:400:kworker.0 Request processed in 48us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636556.938607:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788636556.938656:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976426112 00000100:00100000:2.0:1788636556.938666:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976426112 00000100:00100000:2.0:1788636556.938696:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976425856 00000100:00100000:2.0:1788636556.938699:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976425856 00000100:00100000:2.0:1788636556.938710:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976425984 00000100:00100000:2.0:1788636556.938712:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976425984 00000100:00100000:2.0:1788636556.938727:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636556.938733:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976426112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938764:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3280:x1875520976426112:12345-0@lo:400:kworker.0 Request processed in 31us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636556.938770:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636556.938782:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636556.938788:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976425856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938845:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976425856:12345-0@lo:400:kworker.0 Request processed in 57us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636556.938851:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788636556.938862:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788636556.938868:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976425984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938892:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3282:x1875520976425984:12345-0@lo:400:kworker.0 Request processed in 25us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636556.938898:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:2.0:1788636556.938916:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788636556.938943:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3282:1875520976425984:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938954:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a39f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976425856:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938982:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976425600:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.938993:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3280:1875520976426112:0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.939902:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976425728 00000100:00100000:2.0:1788636556.939910:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976425728 00000100:00100000:2.0:1788636556.939946:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636556.939954:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976425728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636556.940001:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976425728:12345-0@lo:400:kworker.0 Request processed in 48us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636556.940007:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788636556.940033:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976425728:0@lo:400:kworker.0 00000001:00100000:1.0:1788636557.024663:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4a21948e-2331-47c0-8be3-5e0fad8d2f7a 00000001:00100000:1.0:1788636557.024784:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1788636557.024808:0:7625:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1788636557.255875:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636557.256023:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963849088 00000100:00100000:2.0:1788636557.256045:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963849088 00000100:00100000:2.0:1788636557.256156:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:2.0:1788636557.256168:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:13871:x1875520963849088:12345-192.168.203.57@tcp:41:lfs.0 00000004:00000024:2.0:1788636557.256210:0:14466:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788636557.256305:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:13871:x1875520963849088:12345-192.168.203.57@tcp:41:lfs.0 Request processed in 139us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636557.256313:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00080000:1.0:1788636557.256451:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788636557.264123:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.264729:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963849216 00000100:00100000:0.0:1788636557.264745:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963849216 00000100:00100000:0.0:1788636557.264891:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:0.0:1788636557.264906:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13871:x1875520963849216:12345-192.168.203.57@tcp:13:lfs.0 00002000:00000024:0.0:1788636557.264960:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636557.265105:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:13871:x1875520963849216:12345-192.168.203.57@tcp:13:lfs.0 Request processed in 202us (992us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.265132:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00080000:1.0:1788636557.265698:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636557.269059:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636557.269415:0:15150:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963849344 00000100:00100000:2.0:1788636557.269441:0:15150:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963849344 00000100:00100000:2.0:1788636557.269518:0:15150:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:2.0:1788636557.269530:0:15150:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:13871:x1875520963849344:12345-192.168.203.57@tcp:13:lfs.0 00002000:00000024:2.0:1788636557.269563:0:15150:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636557.269675:0:15150:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:13871:x1875520963849344:12345-192.168.203.57@tcp:13:lfs.0 Request processed in 147us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636557.269683:0:15150:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00080000:1.0:1788636557.269843:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636557.466857:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.466992:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963849472 00000100:00100000:0.0:1788636557.467003:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963849472 00000100:00100000:0.0:1788636557.467179:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 91 00000100:00100000:0.0:1788636557.467191:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+10:13900:x1875520963849472:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636557.467210:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636557.467228:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191c400/0xa6aa59fb12fa8661 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155957 expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.467256:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191c400/0xa6aa59fb12fa8661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155957 expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.467267:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191c400/0xa6aa59fb12fa8661 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155957 expref: 11 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.467278:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191c400, rc 0) 00000100:00100000:0.0:1788636557.467350:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+11:13900:x1875520963849472:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 161us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.467358:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 91 00000100:00100000:3.0:1788636557.473389:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636557.473538:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963849600 00000100:00100000:2.0:1788636557.473548:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963849600 00000100:00100000:2.0:1788636557.473676:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 92 00000100:00100000:2.0:1788636557.473687:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+11:13900:x1875520963849600:12345-192.168.203.57@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788636557.474069:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d044450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+11:13900:x1875520963849600:12345-192.168.203.57@tcp:501:mount.lustre.0 Request processed in 373us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636557.474082:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 92 00000100:00100000:1.0:1788636557.484701:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.484825:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963849728 00000100:00100000:0.0:1788636557.484835:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963849728 00000100:00100000:0.0:1788636557.484892:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 93 00000100:00100000:0.0:1788636557.484902:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+11:13900:x1875520963849728:12345-192.168.203.57@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788636557.485303:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+11:13900:x1875520963849728:12345-192.168.203.57@tcp:503:mount.lustre.0 Request processed in 401us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.485322:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 93 00000100:00100000:3.0:1788636557.491312:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.491532:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963849856 00000100:00100000:0.0:1788636557.491546:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963849856 00000100:00100000:0.0:1788636557.491638:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 94 00000100:00100000:0.0:1788636557.491654:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+11:13909:x1875520963849856:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636557.492143:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+11:13909:x1875520963849856:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 491us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.492154:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 94 00000100:00100000:3.0:1788636557.503176:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636557.503247:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963849984 00000100:00100000:2.0:1788636557.503257:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963849984 00000100:00100000:2.0:1788636557.503313:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 95 00000100:00100000:2.0:1788636557.503322:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+11:13909:x1875520963849984:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788636557.503564:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+11:13909:x1875520963849984:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 242us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636557.503572:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 95 00000100:00100000:1.0:1788636557.506882:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.506979:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963850112 00000100:00100000:0.0:1788636557.506989:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963850112 00000100:00100000:0.0:1788636557.507045:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 96 00000100:00100000:0.0:1788636557.507055:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+11:13900:x1875520963850112:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636557.507082:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636557.507100:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191ca00/0xa6aa59fb12fa8668 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155981 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.507128:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191ca00/0xa6aa59fb12fa8668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155981 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.507140:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191ca00/0xa6aa59fb12fa8668 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155981 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.507149:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191ca00, rc 0) 00000100:00100000:0.0:1788636557.507966:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d044850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+12:13900:x1875520963850112:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 906us (1087us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.507976:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 96 00000100:00100000:3.0:1788636557.512846:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.512948:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963850240 00000100:00100000:0.0:1788636557.512958:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963850240 00000100:00100000:0.0:1788636557.513011:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 97 00000100:00100000:0.0:1788636557.513020:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+12:13900:x1875520963850240:12345-192.168.203.57@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788636557.513044:0:14458:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788636557.513078:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788636557.513083:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788636557.513086:0:14458:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788636557.513089:0:14458:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788636557.514955:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+12:13900:x1875520963850240:12345-192.168.203.57@tcp:256:mount.lustre.0 Request processed in 1925us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.514968:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 97 00000100:00100000:1.0:1788636557.528347:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.528552:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963850368 00000100:00100000:0.0:1788636557.528561:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963850368 00000100:00100000:0.0:1788636557.528618:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 98 00000100:00100000:0.0:1788636557.528629:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+12:13900:x1875520963850368:12345-192.168.203.57@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788636557.528645:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636557.528663:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb982844835155988 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.528690:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.528702:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636557.528712:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191da00, rc 0) 00000100:00100000:0.0:1788636557.528767:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d046c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+13:13900:x1875520963850368:12345-192.168.203.57@tcp:101:mount.lustre.0 Request processed in 139us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.528787:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 98 00000100:00100000:3.0:1788636557.533013:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.533186:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963850496 00000100:00100000:0.0:1788636557.533204:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963850496 00000100:00100000:0.0:1788636557.533308:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 99 00000100:00100000:0.0:1788636557.533318:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+13:13900:x1875520963850496:12345-192.168.203.57@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788636557.533598:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d047450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+13:13900:x1875520963850496:12345-192.168.203.57@tcp:501:mount.lustre.0 Request processed in 280us (807us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.533607:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 99 00000100:00100000:3.0:1788636557.536973:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636557.537166:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963850624 00000100:00100000:2.0:1788636557.537176:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963850624 00000100:00100000:2.0:1788636557.537367:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 100 00000100:00100000:2.0:1788636557.537379:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+13:13900:x1875520963850624:12345-192.168.203.57@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788636557.537716:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d046450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+13:13900:x1875520963850624:12345-192.168.203.57@tcp:503:mount.lustre.0 Request processed in 339us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636557.537725:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 100 00000100:00100000:1.0:1788636557.543076:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.543163:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963850752 00000100:00100000:0.0:1788636557.543172:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963850752 00000100:00100000:0.0:1788636557.543233:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 101 00000100:00100000:0.0:1788636557.543242:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+13:13915:x1875520963850752:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636557.543518:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d044c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+13:13915:x1875520963850752:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 276us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.543526:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 101 00000100:00100000:3.0:1788636557.549135:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.549472:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963850880 00000100:00100000:0.0:1788636557.549483:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963850880 00000100:00100000:0.0:1788636557.549541:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 102 00000100:00100000:0.0:1788636557.549549:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+13:13915:x1875520963850880:12345-192.168.203.57@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788636557.550077:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+13:13915:x1875520963850880:12345-192.168.203.57@tcp:502:llog_process_th.0 Request processed in 526us (948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.550086:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 102 00000100:00100000:3.0:1788636557.561416:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636557.561524:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963851008 00000100:00100000:2.0:1788636557.561534:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963851008 00000100:00100000:2.0:1788636557.561595:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:2.0:1788636557.561604:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2359:x1875520963851008:12345-192.168.203.57@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788636557.561653:0:14464:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 61f30443-f7d9-4279-b5c2-d68139438f4b@192.168.203.57@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:2.0:1788636557.561688:0:14464:0:(genops.c:1385:class_connect()) connect: client 61f30443-f7d9-4279-b5c2-d68139438f4b, cookie 0xa6aa59fb12fa8676 00000004:00100000:2.0:1788636557.561722:0:14464:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788636557.561876:0:14464:0:(import.c:65:import_set_state_nolock()) ffff9cfd58a95000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788636557.561957:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2359:x1875520963851008:12345-192.168.203.57@tcp:38:mount.lustre.0 Request processed in 352us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636557.561967:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:1.0:1788636557.565421:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636557.565474:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636557.565554:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963851264 00000100:00100000:3.0:1788636557.565563:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963851264 00000100:00100000:3.0:1788636557.565630:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963851136 00000100:00100000:3.0:1788636557.565633:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963851136 00000100:00100000:3.0:1788636557.565648:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:3.0:1788636557.565657:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+7:13900:x1875520963851264:12345-192.168.203.57@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788636557.565685:0:14465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788636557.565751:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+7:13900:x1875520963851264:12345-192.168.203.57@tcp:41:mount.lustre.0 Request processed in 95us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636557.565758:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:3.0:1788636557.565774:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:3.0:1788636557.565781:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+6:0:x1875520963851136:12345-192.168.203.57@tcp:41:mount.lustre.0 00000100:00080000:1.0:1788636557.565907:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:3.0:1788636557.566351:0:14465:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788636557.566567:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+6:0:x1875520963851136:12345-192.168.203.57@tcp:41:mount.lustre.0 Request processed in 784us (1090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636557.566576:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:1.0:1788636557.571041:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.571156:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963851392 00000100:00100000:0.0:1788636557.571165:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963851392 00000100:00100000:0.0:1788636557.571320:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:0.0:1788636557.571329:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61f30443-f7d9-4279-b5c2-d68139438f4b+6:13900:x1875520963851392:12345-192.168.203.57@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788636557.571453:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61f30443-f7d9-4279-b5c2-d68139438f4b+6:13900:x1875520963851392:12345-192.168.203.57@tcp:40:mount.lustre.0 Request processed in 125us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636557.571460:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:0.0:1788636557.574039:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.574144:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636557.574192:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636557.574276:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963851520 00000100:00100000:1.0:1788636557.574287:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963851520 00000100:00100000:1.0:1788636557.574328:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963851648 00000100:00100000:1.0:1788636557.574331:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963851648 00000100:00100000:1.0:1788636557.574358:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:1.0:1788636557.574366:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1875520963851520:12345-192.168.203.57@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788636557.574399:0:15876:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 61f30443-f7d9-4279-b5c2-d68139438f4b@192.168.203.57@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1788636557.574447:0:15876:0:(genops.c:1385:class_connect()) connect: client 61f30443-f7d9-4279-b5c2-d68139438f4b, cookie 0xa6aa59fb12fa867d 00002000:00100000:1.0:1788636557.574458:0:15876:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 61f30443-f7d9-4279-b5c2-d68139438f4b/ffff9cfc43a05800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788636557.574475:0:15876:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788636557.574597:0:15876:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788636557.574625:0:15876:0:(import.c:65:import_set_state_nolock()) ffff9cfc43a01000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636557.574688:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2359:x1875520963851520:12345-192.168.203.57@tcp:8:mount.lustre.0 Request processed in 321us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636557.574695:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:1.0:1788636557.574712:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:1.0:1788636557.574717:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2359:x1875520963851648:12345-192.168.203.57@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788636557.574744:0:15876:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 61f30443-f7d9-4279-b5c2-d68139438f4b@192.168.203.57@tcp t0 exp 0000000000000000 cur 426 last 0 00000020:00000080:1.0:1788636557.574762:0:15876:0:(genops.c:1385:class_connect()) connect: client 61f30443-f7d9-4279-b5c2-d68139438f4b, cookie 0xa6aa59fb12fa8684 00002000:00100000:1.0:1788636557.574767:0:15876:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 61f30443-f7d9-4279-b5c2-d68139438f4b/ffff9cfc43a05000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788636557.574785:0:15876:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788636557.575023:0:15876:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788636557.575040:0:15876:0:(import.c:65:import_set_state_nolock()) ffff9cfc43a00000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788636557.575076:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2359:x1875520963851648:12345-192.168.203.57@tcp:8:mount.lustre.0 Request processed in 358us (893us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636557.575083:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:2.0:1788636557.577867:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963851776 00000100:00100000:2.0:1788636557.577882:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963851776 00000100:00100000:2.0:1788636557.577947:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:2.0:1788636557.577959:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+6:13900:x1875520963851776:12345-192.168.203.57@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788636557.578043:0:14468:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788636557.578149:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+6:13900:x1875520963851776:12345-192.168.203.57@tcp:33:mount.lustre.0 Request processed in 192us (4120us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636557.578226:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:0.0:1788636557.804387:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636557.804430:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963851904 00000100:00100000:2.0:1788636557.804449:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963851904 00000100:00100000:2.0:1788636557.804512:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:2.0:1788636557.804521:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:13936:x1875520963851904:12345-192.168.203.57@tcp:101:mkdir.0 00010000:00010000:2.0:1788636557.804538:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636557.804557:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1400/0xa6aa59fb12fa868b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559b2 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636557.804627:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636557.804655:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636557.804668:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636557.804705:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788636557.804708:0:14464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636557.804724:0:14464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636557.804748:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1400/0xa6aa59fb12fa868b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 8 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636557.804764:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636557.805087:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd52141100) 00010000:00010000:2.0:1788636557.805091:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636557.805096:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c1000, rc 0) 00000100:00100000:2.0:1788636557.805171:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+7:13936:x1875520963851904:12345-192.168.203.57@tcp:101:mkdir.0 Request processed in 650us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636557.805178:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 14 00010000:00010000:2.0:1788636557.889097:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788636558.496339:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4a21948e-2331-47c0-8be3-5e0fad8d2f7a 00000001:00100000:0.0:1788636558.496491:0:6685:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 61f30443-f7d9-4279-b5c2-d68139438f4b 00010000:00010000:1.0:1788636558.912117:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636559.935149:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788636560.045627:0:5832:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4a21948e-2331-47c0-8be3-5e0fad8d2f7a 00000001:00100000:2.0:1788636560.045643:0:5832:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 61f30443-f7d9-4279-b5c2-d68139438f4b 00000100:00100000:2.0:1788636560.512845:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636560.512879:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976426240:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788636560.512952:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636560.513384:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976426240 00000100:00100000:0.0:1788636560.513393:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976426240 00000100:00100000:0.0:1788636560.513460:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788636560.513470:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976426240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788636560.513504:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636560.513551:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976426240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636560.513558:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788636560.513670:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636560.515757:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976426240:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788636560.968225:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788636561.303132:0:16431:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788636561.987415:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636562.047405:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976426752:0@lo:400:kworker.0 00000100:00100000:3.0:1788636562.047477:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636562.047539:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636562.047546:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976426624:0@lo:400:kworker.0 00000100:00100000:3.0:1788636562.047573:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636562.047612:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976426624 00000100:00100000:3.0:1788636562.047620:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976426624 00000100:00100000:3.0:1788636562.047675:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788636562.047686:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976426624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636562.047737:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976426624:12345-0@lo:400:kworker.0 Request processed in 54us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636562.047745:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788636562.047766:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636562.047790:0:3281:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1788636562.047828:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976426624:0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.047901:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976426496:0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.047932:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636562.047960:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976427008:0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.047982:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636562.047998:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788636562.048004:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3283:1875520976426368:0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.048057:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636562.048078:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd612c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976426880:0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.048099:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636562.048127:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976426752 00000100:00100000:0.0:1788636562.048132:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976426752 00000100:00100000:0.0:1788636562.048167:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976427008 00000100:00100000:0.0:1788636562.048171:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976427008 00000100:00100000:0.0:1788636562.048192:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976426880 00000100:00100000:0.0:1788636562.048195:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976426880 00000100:00100000:0.0:1788636562.048210:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636562.048216:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976426752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.048254:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976426752:12345-0@lo:400:kworker.0 Request processed in 37us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636562.048260:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788636562.048272:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636562.048278:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976427008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.048309:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976427008:12345-0@lo:400:kworker.0 Request processed in 31us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636562.048315:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788636562.048326:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788636562.048332:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976426880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.048357:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3283:x1875520976426880:12345-0@lo:400:kworker.0 Request processed in 26us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636562.048363:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1788636562.048380:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636562.048398:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3283:1875520976426880:0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.048421:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976427008:0@lo:400:kworker.0 00000100:00100000:0.0:1788636562.048446:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976426752:0@lo:400:kworker.0 00000100:00100000:3.0:1788636562.048583:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976426496 00000100:00100000:3.0:1788636562.048588:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976426496 00000100:00100000:3.0:1788636562.048630:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788636562.048638:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976426496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636562.048674:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976426496:12345-0@lo:400:kworker.0 Request processed in 37us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636562.048680:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788636562.048831:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636562.048851:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976426496:0@lo:400:kworker.0 00000100:00100000:2.0:1788636562.049002:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976426368 00000100:00100000:2.0:1788636562.049008:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976426368 00000100:00100000:2.0:1788636562.049051:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1788636562.049059:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3283:x1875520976426368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788636562.049109:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d044050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3283:x1875520976426368:12345-0@lo:400:kworker.0 Request processed in 51us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636562.049115:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788636562.049296:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd612c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3283:1875520976426368:0@lo:400:kworker.0 00000100:00100000:1.0:1788636562.052005:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788636562.052040:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc41c59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976427136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788636562.052105:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636562.052376:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976427136 00000100:00100000:0.0:1788636562.052385:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976427136 00000100:00100000:0.0:1788636562.052437:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636562.052447:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976427136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788636562.052481:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788636562.052534:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976427136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636562.052541:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788636562.052587:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc41c59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976427136:0@lo:13:osp-pre-1-0.0 00000001:00100000:1.0:1788636562.084525:0:7625:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 61f30443-f7d9-4279-b5c2-d68139438f4b 00000040:00080000:3.0:1788636562.367779:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788636563.014001:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636563.028225:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636563.028299:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963852032 00000100:00100000:2.0:1788636563.028308:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963852032 00000100:00100000:2.0:1788636563.028367:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 104 00000100:00100000:2.0:1788636563.028377:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+13:2363:x1875520963852032:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636563.028446:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d045c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+13:2363:x1875520963852032:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 71us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636563.028453:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 104 00000100:00100000:0.0:1788636563.039446:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636563.039489:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636563.039520:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636563.039551:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963852416 00000100:00100000:0.0:1788636563.039560:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963852416 00000100:00100000:0.0:1788636563.039616:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963852672 00000100:00100000:0.0:1788636563.039620:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963852672 00000100:00100000:0.0:1788636563.039643:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:0.0:1788636563.039652:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2362:x1875520963852416:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636563.039728:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2362:x1875520963852416:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 77us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636563.039758:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:0.0:1788636563.039776:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:0.0:1788636563.039783:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2362:x1875520963852672:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636563.039834:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2362:x1875520963852672:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 51us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636563.039840:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00080000:0.0:1788636563.039859:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636563.039863:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636563.044211:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963852160 00000100:00100000:3.0:1788636563.044228:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963852160 00000100:00100000:3.0:1788636563.044367:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:3.0:1788636563.044380:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2362:x1875520963852160:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636563.044460:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2362:x1875520963852160:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 83us (5025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636563.044467:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:3.0:1788636563.044532:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636563.044988:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636563.045017:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636563.045069:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963852544 00000100:00100000:3.0:1788636563.045074:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963852544 00000100:00100000:3.0:1788636563.045124:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:3.0:1788636563.045148:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2363:x1875520963852544:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636563.045186:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2363:x1875520963852544:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 54us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636563.045191:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:0.0:1788636563.045346:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963852288 00000100:00100000:0.0:1788636563.045350:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963852288 00000100:00100000:0.0:1788636563.045387:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963852800 00000100:00100000:0.0:1788636563.045390:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963852800 00000100:00100000:0.0:1788636563.045425:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:0.0:1788636563.045449:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2363:x1875520963852288:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636563.045500:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2363:x1875520963852288:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 68us (968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636563.045506:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:0.0:1788636563.045520:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:0.0:1788636563.045539:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2363:x1875520963852800:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636563.045578:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2363:x1875520963852800:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 40us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636563.045585:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00080000:0.0:1788636563.045664:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788636563.045669:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788636563.045671:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788636564.033064:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636565.056389:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788636565.333919:0:16583:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2654cce0 20000000:00000080:3.0:1788636565.333937:0:16583:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cfc41df7000 uarg=0000000000000000 20000000:01000000:3.0:1788636565.333974:0:16583:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788636565.333979:0:16583:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788636565.333983:0:16583:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788636565.338402:0:16584:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1788636565.339838:0:16583:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788636565.348537:0:16583:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788636565.348567:0:16583:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.348584:0:16583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.348606:0:16583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.348613:0:16583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 18 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.348623:0:16583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.348631:0:16583:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.348639:0:16583:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.348680:0:16583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.349929:0:16583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 12 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636565.349949:0:16583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427264:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636565.350319:0:16583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.350329:0:16583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 12 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636565.350339:0:16583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427392:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636565.350389:0:16583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 18 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.350397:0:16583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 18 pid: 14458 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636565.350406:0:16583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427520:0@lo:104: 00000100:00100000:3.0:1788636565.350442:0:16583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788636565.350484:0:16583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.350493:0:16583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 18 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636565.350501:0:16583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427648:0@lo:104: 00000100:00100000:3.0:1788636565.350523:0:16583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636565.350541:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976427520 00010000:00010000:3.0:1788636565.350546:0:16583:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 18 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636565.350548:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976427520 00010000:00010000:3.0:1788636565.350553:0:16583:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 18 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636565.350560:0:16583:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427776:0@lo:104: 00000100:00100000:3.0:1788636565.350583:0:16583:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636565.350594:0:16583:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d281a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788636565.350603:0:14448:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788636565.350614:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976427648 00000100:00100000:2.0:1788636565.350617:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976427648 00000100:00100000:2.0:1788636565.350629:0:14448:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976427776 00000100:00100000:2.0:1788636565.350632:0:14448:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976427776 00000100:00100000:2.0:1788636565.350646:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636565.350653:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+5:16583:x1875520976427520:12345-0@lo:104: 00010000:00010000:2.0:1788636565.350673:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636565.350727:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788636565.350734:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+5:16583:x1875520976427520:12345-0@lo:104: Request processed in 81us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636565.350741:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788636565.350757:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636565.350763:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+4:16583:x1875520976427648:12345-0@lo:104: 00010000:00010000:2.0:1788636565.350771:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636565.350825:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788636565.350830:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+4:16583:x1875520976427648:12345-0@lo:104: Request processed in 68us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636565.350836:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788636565.350848:0:14448:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788636565.350855:0:14448:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f369c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:16583:x1875520976427776:12345-0@lo:104: 00010000:00010000:2.0:1788636565.350862:0:14448:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636565.350887:0:14448:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788636565.350892:0:14448:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f369c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+3:16583:x1875520976427776:12345-0@lo:104: Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636565.350898:0:14448:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636565.350930:0:16583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427520:0@lo:104: 00000100:00100000:3.0:1788636565.350939:0:16583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427648:0@lo:104: 00000100:00100000:3.0:1788636565.350945:0:16583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427776:0@lo:104: 00010000:00010000:0.0:1788636565.351706:0:14453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788636565.351716:0:14453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.351724:0:14453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c0a00 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:0.0:1788636565.351728:0:14453:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.351736:0:14453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788636565.351744:0:14453:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636565.351749:0:14453:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788636565.351783:0:14453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.351790:0:14453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636565.351859:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788636565.352179:0:16585:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788636565.352301:0:16586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636565.352307:0:16585:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.352314:0:16585:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b000 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:1.0:1788636565.352318:0:16585:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.352325:0:16585:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788636565.352330:0:16585:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788636565.352342:0:16585:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788636565.352358:0:16585:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.352364:0:16585:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788636565.352383:0:16585:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.352389:0:16585:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd8196b000/0xa6aa59fb12fa8389 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8390 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636565.352406:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788636565.352418:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976428032:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636565.352634:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636565.352676:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976428032 00000100:00100000:1.0:1788636565.352682:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976428032 00010000:00010000:1.0:1788636565.352703:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 19 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636565.352727:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636565.352735:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3280:x1875520976428032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636565.352746:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636565.352751:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 19 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.352759:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 19 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.352773:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd6f4ea400/0xa6aa59fb12fa8390 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa8389 expref: 19 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.352792:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636565.352844:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:3280:x1875520976428032:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636565.352852:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788636565.352886:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3280:1875520976428032:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788636565.352902:0:16585:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636565.352904:0:16585:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636565.352906:0:16585:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636565.352909:0:16586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788636565.352910:0:16586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636565.353029:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636565.353048:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd5997d000 already unused, calling callback (ffffffffc1de6c20) 10000000:00010000:2.0:1788636565.353051:0:14452:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636565.353058:0:14452:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788636565.353064:0:14452:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636565.353069:0:14452:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788636565.353087:0:14452:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636565.353093:0:14452:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788636565.353124:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636565.353138:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd5997d000/0xa6aa59fb12fa83d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa83dd expref: -99 pid: 15144 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636565.353151:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636565.353152:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636565.353154:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636565.353318:0:14453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.353327:0:14453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.157@tcp lock: ffff9cfd699c0a00/0xa6aa59fb12fa8511 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xa6aa59fb12fa8518 expref: -99 pid: 15864 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.353341:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636565.353343:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788636565.353344:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788636565.353393:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976428160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636565.353423:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636565.353679:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976428160 00000100:00100000:0.0:1788636565.353685:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976428160 00010000:00010000:0.0:1788636565.353706:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 18 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636565.353729:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788636565.353736:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:3282:x1875520976428160:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636565.353745:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636565.353749:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 18 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.353757:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 18 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.353768:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd8196a800/0xa6aa59fb12fa83dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa83d6 expref: 18 pid: 14459 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.353778:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636565.353829:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:3282:x1875520976428160:12345-0@lo:103:ldlm_bl.0 Request processed in 94us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636565.353836:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788636565.353908:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976428160:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636565.353921:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788636565.353926:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976427904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636565.353951:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636565.354231:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976427904 00000100:00100000:0.0:1788636565.354235:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976427904 00010000:00010000:0.0:1788636565.354249:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 17 pid: 14458 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636565.354998:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788636565.355017:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41abc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:3282:x1875520976427904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788636565.355029:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636565.355035:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 17 pid: 14458 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.355055:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 17 pid: 14458 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.355068:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd8196aa00/0xa6aa59fb12fa8518 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xa6aa59fb12fa8511 expref: 17 pid: 14458 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636565.355079:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636565.355140:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41abc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:3282:x1875520976427904:12345-0@lo:103:ldlm_bl.0 Request processed in 127us (1180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636565.355147:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788636565.356553:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3282:1875520976427904:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788636565.358748:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636565.358817:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636565.358846:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963852928 00000100:00100000:1.0:1788636565.358854:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963852928 00010000:00010000:1.0:1788636565.358889:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 13 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636565.358912:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963853056 00000100:00100000:1.0:1788636565.358916:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963853056 00010000:00010000:1.0:1788636565.358927:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 14 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636565.358953:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:1.0:1788636565.358961:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41e3de15-0175-4e7c-8623-04ef993a057c+14:2362:x1875520963852928:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636565.358975:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636565.358981:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 14 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.358993:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 14 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359024:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636565.359073:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41e3de15-0175-4e7c-8623-04ef993a057c+14:2362:x1875520963852928:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 112us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636565.359080:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:1.0:1788636565.359099:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:1.0:1788636565.359105:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41e3de15-0175-4e7c-8623-04ef993a057c+13:2362:x1875520963853056:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636565.359113:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636565.359117:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 13 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359126:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 13 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359148:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359157:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359178:0:14450:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359185:0:14450:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359192:0:14450:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359200:0:14450:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359206:0:14450:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990c00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636565.359210:0:14450:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359218:0:14450:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359227:0:14450:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636565.359237:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636565.359257:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:41e3de15-0175-4e7c-8623-04ef993a057c+13:2362:x1875520963853056:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 153us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636565.359264:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00010000:00010000:3.0:1788636565.361506:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa866f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155988 expref: 12 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636565.361528:0:16583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427264:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636565.361543:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfd699c0000/0xa6aa59fb12fa8637 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155926 expref: 11 pid: 14457 timeout: 534 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636565.361553:0:16583:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16583:1875520976427392:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636565.361589:0:16583:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.361599:0:16583:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.361606:0:16583:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636565.361612:0:16583:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cfc41990c00/0xa6aa59fb12fa8699 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16583 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636565.631979:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976428288:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636565.632061:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636565.632173:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976428288 00000100:00100000:2.0:1788636565.632182:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976428288 00000100:00100000:2.0:1788636565.632253:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788636565.632264:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976428288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636565.632298:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636565.632355:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976428288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636565.632363:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1788636565.632415:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788636565.632458:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976428288:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788636566.079279:0:16585:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636567.053117:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636567.053213:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963853184 00000100:00100000:2.0:1788636567.053224:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963853184 00000100:00100000:2.0:1788636567.053280:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 105 00000100:00100000:2.0:1788636567.053290:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd5d046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+11:13788:x1875520963853184:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636567.053306:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636567.053324:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd699c0200/0xa6aa59fb12fa86a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351559b9 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.053353:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd699c0200/0xa6aa59fb12fa86a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559b9 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.053364:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd699c0200/0xa6aa59fb12fa86a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559b9 expref: 12 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.053374:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c0200, rc 0) 00000100:00100000:2.0:1788636567.053430:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd5d046850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+12:13788:x1875520963853184:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 Request processed in 142us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636567.053437:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 105 00000100:00100000:1.0:1788636567.059195:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636567.059307:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963853312 00000100:00100000:2.0:1788636567.059317:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963853312 00000100:00100000:2.0:1788636567.059366:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 106 00000100:00100000:2.0:1788636567.059375:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+12:13788:x1875520963853312:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636567.059635:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa19c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+12:13788:x1875520963853312:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 Request processed in 260us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636567.059654:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 106 00000100:00100000:2.0:1788636567.071282:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636567.071327:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963853440 00000100:00100000:2.0:1788636567.071335:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963853440 00000100:00100000:2.0:1788636567.071378:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 107 00000100:00100000:2.0:1788636567.071387:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+12:13788:x1875520963853440:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788636567.071586:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+12:13788:x1875520963853440:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 Request processed in 199us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636567.071594:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 107 00000100:00100000:2.0:1788636567.089285:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636567.089321:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963853568 00000100:00100000:2.0:1788636567.089330:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963853568 00000100:00100000:2.0:1788636567.089375:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 108 00000100:00100000:2.0:1788636567.089386:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+12:13788:x1875520963853568:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636567.089402:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636567.089421:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd699c1200/0xa6aa59fb12fa86a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb9828448351559c0 expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.089448:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd699c1200/0xa6aa59fb12fa86a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559c0 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.089459:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd699c1200/0xa6aa59fb12fa86a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559c0 expref: 13 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.089468:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c1200, rc 0) 00000100:00100000:2.0:1788636567.089517:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa18050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41e3de15-0175-4e7c-8623-04ef993a057c+13:13788:x1875520963853568:12345-192.168.203.57@tcp:101:ll_cfg_requeue.0 Request processed in 132us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636567.089531:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 108 00000100:00100000:2.0:1788636567.101740:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636567.101773:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963853696 00000100:00100000:2.0:1788636567.101781:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963853696 00000100:00100000:2.0:1788636567.101839:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 109 00000100:00100000:2.0:1788636567.101848:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+13:13788:x1875520963853696:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636567.102131:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa19850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+13:13788:x1875520963853696:12345-192.168.203.57@tcp:501:ll_cfg_requeue.0 Request processed in 283us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636567.102139:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 109 10000000:01000000:3.0:1788636567.104148:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788636567.104154:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd7abc6000 from 10 10000000:01000000:3.0:1788636567.104159:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788636567.106738:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfc41991a00/0xa6aa59fb12fa86ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636567.106756:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfc41991a00/0xa6aa59fb12fa86ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636567.106768:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfc41991a00/0xa6aa59fb12fa86ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636567.106820:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788636567.106888:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636567.106930:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d281000 going to sleep for 11 seconds 00010000:00010000:1.0:1788636567.107332:0:16586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636567.108912:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636567.109057:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976428416 00000100:00100000:2.0:1788636567.109065:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976428416 00000100:00100000:2.0:1788636567.109104:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963853824 00000100:00100000:2.0:1788636567.109107:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963853824 00000100:00100000:2.0:1788636567.109122:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788636567.109629:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+16:14461:x1875520976428416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788636567.109645:0:14458:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636567.109660:0:14458:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd699c1e00/0xa6aa59fb12fa86b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa86ae expref: -99 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.109684:0:14458:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd699c1e00/0xa6aa59fb12fa86b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa86ae expref: 17 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.109695:0:14458:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd699c1e00/0xa6aa59fb12fa86b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa86ae expref: 17 pid: 14458 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.109704:0:14458:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c1e00, rc 0) 00000100:00100000:2.0:1788636567.109760:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:14461:x1875520976428416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (2872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636567.113714:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 111 00000100:00100000:3.0:1788636567.113735:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+13:13788:x1875520963853824:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636567.114270:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+13:13788:x1875520963853824:12345-192.168.203.57@tcp:503:ll_cfg_requeue.0 Request processed in 542us (5362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636567.114279:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 111 00000100:00100000:0.0:1788636567.115917:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636567.115943:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfc41991a00/0xa6aa59fb12fa86ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86b5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.115957:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfc41991a00/0xa6aa59fb12fa86ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa86b5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636567.116147:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.116202:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636567.116239:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f947300 going to sleep for 11 seconds 00000100:00100000:0.0:1788636567.116259:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976428544 00000100:00100000:0.0:1788636567.116264:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976428544 00000100:00100000:0.0:1788636567.116295:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788636567.116302:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:14461:x1875520976428544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788636567.116646:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788636567.119846:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:14461:x1875520976428544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3535us (3635us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636567.119881:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788636567.119945:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636567.120008:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636567.120036:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d2810c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636567.120051:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976428672 00000100:00100000:3.0:1788636567.120056:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976428672 00000100:00100000:0.0:1788636567.120087:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788636567.120096:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788636567.120103:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:14461:x1875520976428672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788636567.120474:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:14461:x1875520976428672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 370us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636567.120481:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788636567.128411:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788636567.142278:0:16649:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788636567.142344:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788636567.142362:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788636567.142372:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfc41991a00/0xa6aa59fb12fa86ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86b5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.142384:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfc41991a00/0xa6aa59fb12fa86ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86b5 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788636567.142393:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788636567.142396:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd5d264800 from 10 10000000:01000000:0.0:1788636567.142399:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788636567.142433:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8191de00/0xa6aa59fb12fa86bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.142441:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd8191de00/0xa6aa59fb12fa86bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.142452:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd8191de00/0xa6aa59fb12fa86bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636567.142773:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.143068:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636567.143108:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f947f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788636567.143769:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976428800 00000100:00100000:1.0:1788636567.143777:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976428800 00000100:00100000:1.0:1788636567.143836:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788636567.143845:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+17:14461:x1875520976428800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788636567.143915:0:14457:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636567.144056:0:14457:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8196a200/0xa6aa59fb12fa86c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa86bc expref: -99 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636567.144082:0:14457:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8196a200/0xa6aa59fb12fa86c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa86bc expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636567.144094:0:14457:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8196a200/0xa6aa59fb12fa86c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa86bc expref: 18 pid: 14457 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636567.144102:0:14457:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a200, rc 0) 00000100:00100000:1.0:1788636567.144161:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:14461:x1875520976428800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 317us (1093us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636567.144851:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636567.144868:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd8191de00/0xa6aa59fb12fa86bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86c3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.144894:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd8191de00/0xa6aa59fb12fa86bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa86c3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636567.144963:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636567.145483:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1788636567.145503:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636567.145579:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd7f947f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788636567.146500:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976428928 00000100:00100000:0.0:1788636567.146508:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976428928 00000100:00100000:3.0:1788636567.151874:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788636567.152666:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:14461:x1875520976428928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.153024:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa08c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:14461:x1875520976428928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1136us (7518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636567.153033:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788636567.153158:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976428928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788636567.153982:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81964700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976429056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788636567.155065:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636567.155113:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd471c4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788636567.156597:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976429056 00000100:00100000:3.0:1788636567.156608:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976429056 00000100:00100000:3.0:1788636567.156671:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788636567.156681:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:14461:x1875520976429056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.158674:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa08050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:14461:x1875520976429056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1988us (3603us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636567.158686:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788636567.158766:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81964700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976429056:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788636567.163950:0:16651:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788636567.166685:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788636567.166721:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788636567.166743:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd8191de00/0xa6aa59fb12fa86bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86c3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.166754:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd8191de00/0xa6aa59fb12fa86bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86c3 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788636567.166766:0:14461:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788636567.166769:0:14461:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cfd610d7000 from 10 10000000:01000000:2.0:1788636567.166772:0:14461:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788636567.166829:0:14461:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd699c1400/0xa6aa59fb12fa86ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.166837:0:14461:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.157@tcp lock: ffff9cfd699c1400/0xa6aa59fb12fa86ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636567.166848:0:14461:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.157@tcp lock: ffff9cfd699c1400/0xa6aa59fb12fa86ca lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636567.166874:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976429184:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788636567.166938:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636567.167007:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d280180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636567.171510:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976429184 00000100:00100000:0.0:1788636567.171536:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976429184 00000100:00100000:0.0:1788636567.171593:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788636567.171605:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+18:14461:x1875520976429184:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636567.171621:0:14459:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636567.171639:0:14459:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa86d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xa6aa59fb12fa86ca expref: -99 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.171668:0:14459:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa86d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xa6aa59fb12fa86ca expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.171691:0:14459:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cfd8191da00/0xa6aa59fb12fa86d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xa6aa59fb12fa86ca expref: 19 pid: 14459 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.171700:0:14459:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191da00, rc 0) 00000100:00100000:0.0:1788636567.171789:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa09c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:14461:x1875520976429184:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 187us (4851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636567.171812:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788636567.171865:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976429184:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788636567.171884:0:14461:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.157@tcp lock: ffff9cfd699c1400/0xa6aa59fb12fa86ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86d1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636567.171894:0:14461:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.157@tcp lock: ffff9cfd699c1400/0xa6aa59fb12fa86ca lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xa6aa59fb12fa86d1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636567.171985:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976429312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.172027:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636567.172057:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc4108a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636567.172070:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976429312 00000100:00100000:0.0:1788636567.172074:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976429312 00000100:00100000:0.0:1788636567.172094:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788636567.172099:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:14461:x1875520976429312:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.172337:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:14461:x1875520976429312:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636567.172345:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788636567.172373:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976429312:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.172410:0:14461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976429440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.172447:0:14461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636567.172461:0:14461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfc4108a180 going to sleep for 11 seconds 00000100:00100000:0.0:1788636567.172472:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976429440 00000100:00100000:0.0:1788636567.172476:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976429440 00000100:00100000:0.0:1788636567.172492:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788636567.172498:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:14461:x1875520976429440:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.172629:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:14461:x1875520976429440:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 130us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636567.172636:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788636567.172672:0:14461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6f6af100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:c8fa81e7-22d5-4023-a9dc-119f1fc21189:14461:1875520976429440:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788636567.179761:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976429568:0@lo:400:kworker.0 00000100:00100000:3.0:1788636567.179826:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976429952:0@lo:400:kworker.0 00000100:00100000:0.0:1788636567.179846:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636567.179852:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636567.179882:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976430080:0@lo:400:kworker.0 00000100:00100000:3.0:1788636567.179888:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976429696:0@lo:400:kworker.0 00000100:00100000:0.0:1788636567.179904:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636567.179905:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636567.179922:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000040:00080000:1.0:1788636567.180321:0:16653:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788636567.180397:0:14461:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 00000100:00100000:3.0:1788636567.180851:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976430208:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788636567.180886:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636567.180908:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976429824:0@lo:400:kworker.0 10000000:01000000:1.0:1788636567.181287:0:14461:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.157@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788636567.181298:0:14461:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.157@tcp lock: ffff9cfd699c1400/0xa6aa59fb12fa86ca lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86d1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636567.181310:0:14461:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.157@tcp lock: ffff9cfd699c1400/0xa6aa59fb12fa86ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xa6aa59fb12fa86d1 expref: -99 pid: 14461 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636567.181392:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976430208 00000100:00100000:2.0:1788636567.181399:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976430208 00000100:00100000:2.0:1788636567.181453:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788636567.181463:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976430208:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636567.181503:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788636567.181525:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636567.181546:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b73100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976430208:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (660us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636567.181553:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636567.181571:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976430208:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788636567.181571:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788636567.181615:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976429952 00000100:00100000:3.0:1788636567.181619:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976429952 00000100:00100000:3.0:1788636567.181651:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976430080 00000100:00100000:3.0:1788636567.181654:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976430080 00000100:00100000:3.0:1788636567.181665:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976429824 00000100:00100000:3.0:1788636567.181668:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976429824 00000100:00100000:3.0:1788636567.181680:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636567.181686:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976429952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636567.181713:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976429568 00000100:00100000:0.0:1788636567.181718:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976429568 00000100:00100000:3.0:1788636567.181720:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3280:x1875520976429952:12345-0@lo:400:kworker.0 Request processed in 35us (1868us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636567.181727:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788636567.181739:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636567.181744:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976430080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636567.181746:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976429696 00000100:00100000:0.0:1788636567.181749:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976429696 00000100:00100000:0.0:1788636567.181765:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636567.181771:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976429568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636567.181782:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3281:x1875520976430080:12345-0@lo:400:kworker.0 Request processed in 38us (1878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636567.181788:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788636567.181816:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636567.181817:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3281:x1875520976429568:12345-0@lo:400:kworker.0 Request processed in 46us (1971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636567.181822:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976429824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636567.181823:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788636567.181834:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788636567.181848:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976429696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636567.181851:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3282:x1875520976429824:12345-0@lo:400:kworker.0 Request processed in 31us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636567.181857:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788636567.181874:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976429696:12345-0@lo:400:kworker.0 Request processed in 28us (1968us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636567.181879:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788636567.181881:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3280:1875520976429952:0@lo:400:kworker.0 00000100:00100000:3.0:1788636567.181904:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3282:1875520976429824:0@lo:400:kworker.0 00000100:00100000:3.0:1788636567.181911:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976429696:0@lo:400:kworker.0 00000100:00100000:0.0:1788636567.181911:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3281:1875520976430080:0@lo:400:kworker.0 00000100:00100000:0.0:1788636567.181922:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3281:1875520976429568:0@lo:400:kworker.0 00000100:00080000:2.0:1788636567.182574:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636567.182579:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788636568.137441:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636568.141349:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636568.141391:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636568.141426:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636568.141449:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636568.141466:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636568.141485:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636568.141506:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636568.141532:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963854464 00000100:00100000:2.0:1788636568.141542:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963854464 00000100:00100000:2.0:1788636568.141590:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963854080 00000100:00100000:2.0:1788636568.141592:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963854080 00000100:00100000:2.0:1788636568.141608:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:2.0:1788636568.141617:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2360:x1875520963854464:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636568.141680:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2360:x1875520963854464:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 64us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636568.141688:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:2.0:1788636568.141702:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:2.0:1788636568.141707:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2360:x1875520963854080:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636568.141725:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2360:x1875520963854080:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 18us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636568.141737:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:2.0:1788636568.141757:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963854208 00000100:00100000:2.0:1788636568.141760:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963854208 00000100:00100000:2.0:1788636568.141776:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963854720 00000100:00100000:2.0:1788636568.141779:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963854720 00000100:00100000:2.0:1788636568.141789:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963854336 00000100:00100000:2.0:1788636568.141792:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963854336 00000100:00100000:1.0:1788636568.141963:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963854592 00000100:00100000:1.0:1788636568.141967:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963854592 00000100:00100000:1.0:1788636568.142003:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:1.0:1788636568.142010:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2360:x1875520963854208:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636568.142037:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2360:x1875520963854208:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636568.142043:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:1.0:1788636568.142053:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:1.0:1788636568.142059:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2360:x1875520963854720:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636568.142081:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2360:x1875520963854720:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 22us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636568.142099:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:1.0:1788636568.142111:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:1.0:1788636568.142118:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2360:x1875520963854592:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:1.0:1788636568.142140:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2360:x1875520963854592:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 24us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636568.142147:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:2.0:1788636568.142588:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:2.0:1788636568.142596:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2360:x1875520963854336:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636568.142626:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2360:x1875520963854336:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 32us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636568.142633:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00080000:2.0:1788636568.142649:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636568.142653:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788636568.142656:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636568.142855:0:14458:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963853952 00000100:00100000:0.0:1788636568.142861:0:14458:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963853952 00000100:00100000:0.0:1788636568.142895:0:14458:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 120 00000100:00100000:0.0:1788636568.142903:0:14458:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+13:2360:x1875520963853952:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636568.142935:0:14458:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41e3de15-0175-4e7c-8623-04ef993a057c+13:2360:x1875520963853952:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 34us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636568.142942:0:14458:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 120 00010000:00010000:0.0:1788636569.152020:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788636569.912948:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636569.913486:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963854848 00000100:00100000:3.0:1788636569.913501:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963854848 00000100:00100000:3.0:1788636569.913590:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:3.0:1788636569.913603:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:14449:x1875520963854848:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636569.913630:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636569.913662:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa86d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559c7 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.913754:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.913773:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.913829:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.913868:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.913877:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.913884:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914631:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990000/0xa6aa59fb12fa86ed lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914646:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990000/0xa6aa59fb12fa86ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914655:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990000/0xa6aa59fb12fa86ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636569.914686:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788636569.914691:0:14464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636569.914733:0:14464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990000/0xa6aa59fb12fa86ed lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914744:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914751:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914758:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914915:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990c00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636569.914920:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914929:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914943:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd52141100) 00010000:00010000:3.0:1788636569.914946:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636569.914951:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914957:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa86df lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914970:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914985:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914991:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.914996:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636569.914999:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.915005:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.915188:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cfd4596c800) 00010000:00010000:3.0:1788636569.915190:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636569.915194:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.915200:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa86e6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.915247:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa86d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559c7 expref: 8 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.915261:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990000/0xa6aa59fb12fa86ed lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559c7 expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636569.915270:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cfd4596c600) 00010000:00010000:3.0:1788636569.915272:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636569.915275:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfc41990000, rc 0) 00000100:00100000:3.0:1788636569.915379:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:14449:x1875520963854848:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 1779us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636569.915388:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:2.0:1788636569.929954:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636569.930244:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963855104 00000100:00100000:0.0:1788636569.930258:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963855104 00000100:00100000:0.0:1788636569.930340:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:0.0:1788636569.930354:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:14449:x1875520963855104:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636569.930381:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636569.930413:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa86f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559ce expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.930522:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.930540:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.930572:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.930893:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.930920:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.930933:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931541:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa8709 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931551:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa8709 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931559:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa8709 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636569.931571:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788636569.931906:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931915:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931922:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931928:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636569.931941:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931949:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931960:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cfd4596c600) 00010000:00010000:0.0:1788636569.931963:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636569.931968:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931987:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c600/0xa6aa59fb12fa86fb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.931999:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.932004:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.932010:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.932015:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8191c800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636569.932017:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.932023:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.932030:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cfd500eb100) 00010000:00010000:0.0:1788636569.932032:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636569.932040:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.932046:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191c800/0xa6aa59fb12fa8702 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.936236:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191d200/0xa6aa59fb12fa86f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559ce expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.936262:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8191dc00/0xa6aa59fb12fa8709 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559ce expref: 9 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636569.936270:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd500ebb00) 00010000:00010000:0.0:1788636569.936273:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636569.936276:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8191dc00, rc 0) 00000100:00100000:0.0:1788636569.936415:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14449:x1875520963855104:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 6063us (6473us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788636569.936424:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:0.0:1788636569.942943:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636569.943339:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963855232 00000100:00100000:2.0:1788636569.943352:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963855232 00000100:00100000:2.0:1788636569.943426:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:2.0:1788636569.943439:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14449:x1875520963855232:12345-192.168.203.57@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788636569.943633:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14449:x1875520963855232:12345-192.168.203.57@tcp:59:lhsmtool_posix.0 Request processed in 196us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636569.943642:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:3.0:1788636570.005434:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.005700:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963855360 00000100:00100000:0.0:1788636570.005715:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963855360 00000100:00100000:0.0:1788636570.005863:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:0.0:1788636570.005878:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14455:x1875520963855360:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636570.005918:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636570.005950:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff800/0xa6aa59fb12fa8717 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559d5 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006161:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006197:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006216:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006234:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006242:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006259:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006516:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006526:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006533:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006540:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636570.006546:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006555:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006571:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd52141100) 00010000:00010000:1.0:1788636570.006580:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636570.006587:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006594:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa871e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006611:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006617:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006623:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006629:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196a000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636570.006632:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006638:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006646:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cfd5a43c900) 00010000:00010000:1.0:1788636570.006649:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636570.006652:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006658:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8725 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006697:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff800/0xa6aa59fb12fa8717 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559d5 expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006715:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd52141100) 00010000:00010000:1.0:1788636570.006717:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636570.006721:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff800/0xa6aa59fb12fa8717 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559d5 expref: 10 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.006743:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ff800, rc 0) 00000100:00100000:1.0:1788636570.006874:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14455:x1875520963855360:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1000us (1452us total) trans 0 rc 301/301 00000100:00100000:1.0:1788636570.006883:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00080000:2.0:1788636570.007142:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636570.026459:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636570.026688:0:14473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963855488 00000100:00100000:2.0:1788636570.026703:0:14473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963855488 00000100:00100000:2.0:1788636570.026836:0:14473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:2.0:1788636570.026849:0:14473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14455:x1875520963855488:12345-192.168.203.57@tcp:700:lfs.0 00000100:00100000:2.0:1788636570.026981:0:14473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14455:x1875520963855488:12345-192.168.203.57@tcp:700:lfs.0 Request processed in 126us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636570.026991:0:14473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:0.0:1788636570.029550:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.033069:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963855744 00000100:00100000:3.0:1788636570.033091:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963855744 00000100:00100000:2.0:1788636570.033512:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:2.0:1788636570.033528:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14455:x1875520963855744:12345-192.168.203.57@tcp:36:lfs.0 00010000:00010000:2.0:1788636570.033607:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788636570.033655:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa865a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155950 expref: 9 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.033685:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd52141100) 00010000:00010000:2.0:1788636570.033692:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788636570.034139:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.034158:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 5 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.034169:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.034223:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 5 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.034250:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 5 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636570.034284:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd76a38000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14464:1875520976430336:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636570.034622:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42d5a780 going to sleep for 11 seconds 00000100:00100000:3.0:1788636570.040828:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636570.040988:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd76a38000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14464:1875520976430336:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636570.041033:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636570.041586:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963855872 00000100:00100000:1.0:1788636570.041597:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963855872 00010000:00010000:1.0:1788636570.041672:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 6 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636570.041719:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:1.0:1788636570.041731:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2363:x1875520963855872:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788636570.041750:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636570.041758:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 6 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.041774:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 6 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788636570.042186:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788636570.042307:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa8692 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559b2 expref: 6 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.042418:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd52141100) 00010000:00010000:1.0:1788636570.042429:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.042440:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.042449:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.042529:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636570.042611:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2363:x1875520963855872:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 881us (1831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636570.042621:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00010000:00010000:2.0:1788636570.045564:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.045591:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.045651:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.045668:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.045681:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636570.048528:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788636570.048559:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.048571:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.048591:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.048597:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c1800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636570.048603:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.048612:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.048633:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd52141100) 00010000:00010000:2.0:1788636570.048637:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636570.048643:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.048650:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa872c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788636570.048677:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fa5b6fd5 reply state 00000000f8780ded transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636570.048689:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636570.051284:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+10:14455:x1875520963855744:12345-192.168.203.57@tcp:36:lfs.0 Request processed in 17742us (21731us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788636570.051300:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 19 00010000:00010000:1.0:1788636570.055358:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.055382:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.055391:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.055399:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c0c00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636570.055405:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.055415:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.055458:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cfd52141d00) 00010000:00010000:1.0:1788636570.055462:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636570.055468:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.055474:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8733 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636570.130261:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.130365:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963856000 00000100:00100000:3.0:1788636570.130377:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963856000 00000100:00100000:3.0:1788636570.130480:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:3.0:1788636570.130491:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:14463:x1875520963856000:12345-192.168.203.57@tcp:101:lctl.0 00010000:00010000:3.0:1788636570.130536:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636570.130561:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa873a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559dc expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.130635:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa8741 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.130653:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa8741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.130668:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa8741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636570.130719:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788636570.130723:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636570.130763:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa8741 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.130786:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa873a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559dc expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.130817:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990400/0xa6aa59fb12fa8741 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559dc expref: 10 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.130825:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd4596c800) 00010000:00010000:3.0:1788636570.130828:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636570.130830:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfc41990400, rc 0) 00000100:00100000:3.0:1788636570.130896:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+10:14463:x1875520963856000:12345-192.168.203.57@tcp:101:lctl.0 Request processed in 408us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636570.130913:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 20 00000100:00100000:3.0:1788636570.152615:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636570.152767:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963856128 00000100:00100000:2.0:1788636570.152779:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963856128 00000100:00100000:2.0:1788636570.152891:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:2.0:1788636570.152904:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+5:14464:x1875520963856128:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636570.152950:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636570.152988:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8748 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559e3 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.153075:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0a00/0xa6aa59fb12fa874f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.153095:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0a00/0xa6aa59fb12fa874f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.153110:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0a00/0xa6aa59fb12fa874f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636570.153156:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788636570.153160:0:14464:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636570.153184:0:14464:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0a00/0xa6aa59fb12fa874f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.153212:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8748 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559e3 expref: 7 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.153339:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0a00/0xa6aa59fb12fa874f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559e3 expref: 6 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.153350:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd4596c800) 00010000:00010000:2.0:1788636570.153354:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788636570.153358:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c0a00, rc 0) 00000100:00100000:2.0:1788636570.153469:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:14464:x1875520963856128:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 568us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636570.153478:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 21 00000100:00100000:0.0:1788636570.156045:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.156219:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963856256 00000100:00100000:3.0:1788636570.156232:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963856256 00000100:00100000:3.0:1788636570.156302:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:3.0:1788636570.156314:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61f30443-f7d9-4279-b5c2-d68139438f4b+6:14464:x1875520963856256:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636570.156339:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636570.156365:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8756 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559ea expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.156447:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.156465:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.156478:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.156495:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.156502:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.156508:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157138:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa876b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157172:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa876b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157184:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa876b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636570.157233:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788636570.157237:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636570.157261:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa876b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157274:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157280:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157287:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157292:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990c00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636570.157297:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157304:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157316:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd4596c800) 00010000:00010000:3.0:1788636570.157319:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636570.157323:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157339:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa875d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157357:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157363:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157368:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157372:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990200 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636570.157376:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157382:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157389:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cfd4596ca00) 00010000:00010000:3.0:1788636570.157391:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636570.157394:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157400:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa8764 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157438:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8756 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559ea expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157466:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa876b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559ea expref: 7 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.157473:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cfd4596cd00) 00010000:00010000:3.0:1788636570.157475:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636570.157478:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfc41991800, rc 0) 00000100:00100000:3.0:1788636570.157611:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61f30443-f7d9-4279-b5c2-d68139438f4b+7:14464:x1875520963856256:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 1299us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636570.157620:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 22 00000100:00100000:0.0:1788636570.163008:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636570.168106:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963856512 00000100:00100000:2.0:1788636570.168121:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963856512 00000100:00100000:2.0:1788636570.168197:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:2.0:1788636570.168208:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+7:14464:x1875520963856512:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:2.0:1788636570.168228:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636570.168257:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8772 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559f1 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636570.168369:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788636570.168487:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8772 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559f1 expref: 9 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.168502:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd4596c800) 00010000:00010000:2.0:1788636570.168505:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788636570.168510:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8772 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559f1 expref: 9 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.168525:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c1800, rc 0) 00000100:00100000:2.0:1788636570.168583:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+8:14464:x1875520963856512:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 377us (5584us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788636570.168590:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 23 00000100:00100000:2.0:1788636570.172052:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.172321:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963856768 00000100:00100000:3.0:1788636570.172330:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963856768 00000100:00100000:3.0:1788636570.172413:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 24 00000100:00100000:3.0:1788636570.172425:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61f30443-f7d9-4279-b5c2-d68139438f4b+8:14464:x1875520963856768:12345-192.168.203.57@tcp:36:lfs.0 00010000:00010000:3.0:1788636570.172479:0:14466:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636570.172505:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa876b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559ea expref: 8 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.172524:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cfd4596cd00) 00010000:00010000:3.0:1788636570.172544:0:14466:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636570.172565:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.172578:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.172588:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636570.172845:0:14466:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007b54f394 reply state 00000000e30342ef transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636570.172855:0:14466:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788636570.172863:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788636570.172954:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61f30443-f7d9-4279-b5c2-d68139438f4b+9:14464:x1875520963856768:12345-192.168.203.57@tcp:36:lfs.0 Request processed in 532us (911us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788636570.172962:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 24 00010000:00010000:2.0:1788636570.175437:0:16585:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788636570.176571:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.176708:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963857024 00000100:00100000:1.0:1788636570.176718:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963857024 00000100:00100000:1.0:1788636570.176776:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:1.0:1788636570.176830:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+9:14464:x1875520963857024:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:1.0:1788636570.177377:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+10:14464:x1875520963857024:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 589us (811us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1788636570.177386:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 2 00010000:00010000:0.0:1788636570.178507:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.178521:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.178530:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.178604:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636570.178609:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.178618:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.178635:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cfd4596ca00) 00010000:00010000:0.0:1788636570.178638:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788636570.178643:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.178650:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990800/0xa6aa59fb12fa8780 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636570.180230:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.180331:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963857280 00000100:00100000:1.0:1788636570.180346:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963857280 00000100:00100000:1.0:1788636570.180415:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:1.0:1788636570.180427:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+9:14464:x1875520963857280:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:1.0:1788636570.180461:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636570.180491:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8787 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559f8 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.180585:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.180603:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.180632:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.180651:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.180659:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.180667:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636570.181514:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788636570.181790:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181817:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181825:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181832:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636570.181838:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181847:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181865:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd4596c800) 00010000:00010000:1.0:1788636570.181869:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636570.181887:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181894:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa878e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181910:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181916:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181922:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181927:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196be00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:1.0:1788636570.181929:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181935:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181943:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cfd5a43c900) 00010000:00010000:1.0:1788636570.181945:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788636570.181948:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.181953:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa8795 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.182025:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8787 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559f8 expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.182049:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd4596c800) 00010000:00010000:1.0:1788636570.182052:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788636570.182056:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa8787 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559f8 expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.182067:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196a000, rc 0) 00000100:00100000:1.0:1788636570.182630:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+10:14464:x1875520963857280:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 2200us (2409us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788636570.182641:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 25 00000100:00100000:2.0:1788636570.186026:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.186110:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963857408 00000100:00100000:3.0:1788636570.186123:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963857408 00000100:00100000:3.0:1788636570.186198:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:3.0:1788636570.186208:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd76a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61f30443-f7d9-4279-b5c2-d68139438f4b+10:14464:x1875520963857408:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:3.0:1788636570.186234:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636570.186259:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa87a3 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb9828448351559ff expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.186377:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.186394:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.186408:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788636570.186442:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788636570.186445:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788636570.186467:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.186520:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa87a3 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 12 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.186541:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.186551:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cfd4596cd00) 00010000:00010000:3.0:1788636570.186555:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788636570.186561:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfc41990200, rc 0) 00000100:00100000:3.0:1788636570.186646:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd76a38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:61f30443-f7d9-4279-b5c2-d68139438f4b+11:14464:x1875520963857408:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 438us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636570.186654:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 26 00000100:00100000:0.0:1788636570.194290:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.195027:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963857536 00000100:00100000:1.0:1788636570.195041:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963857536 00000100:00100000:1.0:1788636570.195357:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:1.0:1788636570.195369:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+11:14464:x1875520963857536:12345-192.168.203.57@tcp:37:lfs.0 00000100:00100000:1.0:1788636570.201137:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+11:14464:x1875520963857536:12345-192.168.203.57@tcp:37:lfs.0 Request processed in 5754us (6844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636570.201153:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:2.0:1788636570.204961:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.205315:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963857792 00000100:00100000:3.0:1788636570.205327:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963857792 00000100:00100000:3.0:1788636570.205443:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:3.0:1788636570.205457:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f97dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+11:14464:x1875520963857792:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:3.0:1788636570.205768:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f97dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+12:14464:x1875520963857792:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 313us (820us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788636570.205776:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:0.0:1788636570.250199:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.250252:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963857920 00000100:00100000:0.0:1788636570.251064:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963857920 00000100:00100000:0.0:1788636570.251154:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:0.0:1788636570.251166:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+10:14470:x1875520963857920:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:0.0:1788636570.251195:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636570.251224:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa87b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a06 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.251436:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.251460:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.251483:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.251500:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.251515:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.251524:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.252441:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff000/0xa6aa59fb12fa87c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.252455:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff000/0xa6aa59fb12fa87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.252464:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff000/0xa6aa59fb12fa87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636570.252512:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788636570.252516:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788636570.252970:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff000/0xa6aa59fb12fa87c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.252999:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.253006:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.253013:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.253019:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff600 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636570.253025:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.253034:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.253050:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd4596c800) 00010000:00010000:0.0:1788636570.253054:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636570.253060:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.253067:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff600/0xa6aa59fb12fa87b8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.254226:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.254261:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.254268:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.254273:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fe000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636570.254278:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.254631:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.254650:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cfd500eb100) 00010000:00010000:0.0:1788636570.254654:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636570.254659:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.254666:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa87bf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.255453:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa87b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a06 expref: 12 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.255489:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff000/0xa6aa59fb12fa87c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a06 expref: 11 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.255498:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cfd4596cd00) 00010000:00010000:0.0:1788636570.255501:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788636570.255514:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521ff000, rc 0) 00000100:00100000:0.0:1788636570.255647:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a337480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+11:14470:x1875520963857920:12345-192.168.203.57@tcp:101:bash.0 Request processed in 4479us (5459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636570.255659:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 27 00000100:00100000:0.0:1788636570.259693:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.259853:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963858176 00000100:00100000:1.0:1788636570.259866:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963858176 00000100:00100000:1.0:1788636570.259948:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 28 00000100:00100000:1.0:1788636570.259966:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+11:14470:x1875520963858176:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636570.260005:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636570.260034:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa87cd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a0d expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.260365:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.260393:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.260404:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.260448:0:14464:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 11 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.260464:0:14464:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 11 pid: 14466 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636570.260481:0:14464:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd81964000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14464:1875520976430464:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636570.260593:0:14464:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd471c4900 going to sleep for 11 seconds 00000100:00100000:0.0:1788636570.268162:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.268260:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963858304 00000100:00100000:3.0:1788636570.268271:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963858304 00010000:00010000:3.0:1788636570.268327:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 12 pid: 14466 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636570.268374:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:3.0:1788636570.268384:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+12:2362:x1875520963858304:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636570.268420:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636570.268428:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 12 pid: 14466 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.268444:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 12 pid: 14466 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.268473:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cfd4596cd00) 00010000:00010000:3.0:1788636570.268479:0:14449:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.268491:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.268500:0:14449:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.268526:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636570.268595:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+12:2362:x1875520963858304:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 211us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636570.268603:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00010000:00010000:1.0:1788636570.269147:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990200/0xa6aa59fb12fa87aa lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb9828448351559ff expref: 11 pid: 14466 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636570.269168:0:14464:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd81964000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14464:1875520976430464:192.168.203.57@tcp:104: 00010000:00010000:1.0:1788636570.269196:0:14464:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.269208:0:14464:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.269214:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.269243:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.269265:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.269274:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272612:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272641:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272655:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636570.272671:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788636570.272712:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272721:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272728:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272735:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196be00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636570.272741:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272750:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272781:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cfd4596cd00) 00010000:00010000:0.0:1788636570.272784:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636570.272791:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272845:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196be00/0xa6aa59fb12fa87d4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788636570.272859:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000afcd6a62 reply state 0000000077140176 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636570.272869:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788636570.272919:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a000/0xa6aa59fb12fa87cd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 14 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272935:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 13 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.272942:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636570.272944:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788636570.272946:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe400, rc 0) 00000100:00100000:0.0:1788636570.273055:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:14470:x1875520963858176:12345-192.168.203.57@tcp:101:bash.0 Request processed in 13095us (13376us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788636570.273064:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 28 00010000:00010000:3.0:1788636570.278637:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.278661:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.278670:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.278694:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636570.278700:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.278709:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.278731:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cfd5a43c900) 00010000:00010000:3.0:1788636570.278734:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788636570.278739:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.278746:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b800/0xa6aa59fb12fa87db lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636570.294139:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.294213:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963858432 00000100:00100000:1.0:1788636570.294227:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963858432 00000100:00100000:1.0:1788636570.294295:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 29 00000100:00100000:1.0:1788636570.294307:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+13:14470:x1875520963858432:12345-192.168.203.57@tcp:101:bash.0 00010000:00010000:1.0:1788636570.294336:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636570.294363:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a600/0xa6aa59fb12fa87f0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a14 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.294451:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.294469:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.294484:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788636570.294533:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788636570.294537:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788636570.294563:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.294575:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.295266:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196a600/0xa6aa59fb12fa87f0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 15 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.295291:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 14 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.295302:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:1.0:1788636570.295305:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788636570.295309:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196ae00, rc 0) 00000100:00100000:0.0:1788636570.295518:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:14470:x1875520963858432:12345-192.168.203.57@tcp:101:bash.0 Request processed in 1210us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636570.295527:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 29 00000100:00100000:0.0:1788636570.297788:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.297947:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963858688 00000100:00100000:1.0:1788636570.297960:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963858688 00000100:00100000:1.0:1788636570.298030:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:1.0:1788636570.298041:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:14470:x1875520963858688:12345-192.168.203.57@tcp:35:bash.0 00000100:00100000:1.0:1788636570.298483:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+15:14470:x1875520963858688:12345-192.168.203.57@tcp:35:bash.0 Request processed in 440us (705us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788636570.298491:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00000001:00080000:2.0:1788636570.325253:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934593 is committed 00000001:00080000:2.0:1788636570.325277:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1788636570.325288:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934594 is committed 00000001:00080000:2.0:1788636570.325313:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:1.0:1788636570.374775:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.374929:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963858944 00000100:00100000:0.0:1788636570.374944:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963858944 00000100:00100000:0.0:1788636570.375030:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:0.0:1788636570.375043:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+13:14480:x1875520963858944:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636570.375076:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636570.375116:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa87fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a1b expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636570.375239:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788636570.375402:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa87fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a1b expref: 15 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.375421:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cfd4596c800) 00010000:00010000:0.0:1788636570.375424:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636570.375430:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa87fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a1b expref: 15 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.375447:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fee00, rc 0) 00000100:00100000:0.0:1788636570.375534:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:14480:x1875520963858944:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 493us (774us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788636570.375542:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:1.0:1788636570.378253:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636570.378362:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963859200 00000100:00100000:2.0:1788636570.378374:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963859200 00000100:00100000:2.0:1788636570.378443:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:2.0:1788636570.378454:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:14480:x1875520963859200:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636570.378772:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+15:14480:x1875520963859200:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 319us (531us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788636570.378779:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:1.0:1788636570.429294:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.429477:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963859456 00000100:00100000:0.0:1788636570.429492:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963859456 00000100:00100000:0.0:1788636570.429572:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 31 00000100:00100000:0.0:1788636570.429585:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+15:14483:x1875520963859456:12345-192.168.203.57@tcp:101:lfs.0 00010000:00010000:0.0:1788636570.429616:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636570.429662:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa880c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a22 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.429854:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8813 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.429872:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.429886:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8813 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636570.429900:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788636570.430234:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa880c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a22 expref: 18 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.430261:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8813 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a22 expref: 17 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.430271:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636570.430275:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636570.430279:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe000, rc 0) 00000100:00100000:0.0:1788636570.430464:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+17:14483:x1875520963859456:12345-192.168.203.57@tcp:101:lfs.0 Request processed in 881us (1182us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788636570.430473:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 31 00000100:00100000:1.0:1788636570.433738:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.434008:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963859584 00000100:00100000:3.0:1788636570.434022:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963859584 00000100:00100000:3.0:1788636570.434204:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 32 00000100:00100000:3.0:1788636570.434217:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+17:14483:x1875520963859584:12345-192.168.203.57@tcp:54:lfs.0 00010000:00010000:3.0:1788636570.434311:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434334:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434348:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434385:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434403:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434411:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434417:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41991800 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636570.434422:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434430:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434446:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:3.0:1788636570.434449:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788636570.434455:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.434463:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8821 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636570.434555:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+17:14483:x1875520963859584:12345-192.168.203.57@tcp:54:lfs.0 Request processed in 341us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636570.434563:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 32 00000100:00100000:1.0:1788636570.438664:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.438766:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.438997:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963859968 00000100:00100000:3.0:1788636570.439010:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963859968 00000100:00100000:0.0:1788636570.439161:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:0.0:1788636570.439177:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+17:2361:x1875520963859968:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636570.439199:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636570.439231:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8813 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a22 expref: 17 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.439272:0:14449:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636570.439278:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636570.439352:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+16:2361:x1875520963859968:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 179us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636570.439359:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:2.0:1788636570.440722:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963859840 00000100:00100000:2.0:1788636570.441057:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963859840 00000100:00100000:2.0:1788636570.441224:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:2.0:1788636570.441236:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+16:14483:x1875520963859840:12345-192.168.203.57@tcp:35:lfs.0 00000100:00100000:2.0:1788636570.441559:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+17:14483:x1875520963859840:12345-192.168.203.57@tcp:35:lfs.0 Request processed in 324us (2908us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788636570.441568:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00000040:00080000:0.0:1788636570.559577:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788636570.751655:0:3282:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788636570.751686:0:3282:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976430592:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788636570.751789:0:3282:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636570.752114:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976430592 00000100:00100000:1.0:1788636570.752125:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976430592 00000100:00100000:1.0:1788636570.752206:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788636570.752217:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976430592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788636570.752280:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788636570.752337:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3282:x1875520976430592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 123us (548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636570.752345:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788636570.752535:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636570.752681:0:3282:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3282:1875520976430592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788636570.775641:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.775754:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963860224 00000100:00100000:0.0:1788636570.775765:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963860224 00000100:00100000:0.0:1788636570.775864:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00100000:0.0:1788636570.775877:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+17:14514:x1875520963860224:12345-192.168.203.57@tcp:101:cat.0 00010000:00010000:0.0:1788636570.775901:0:14465:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636570.775921:0:14465:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8828 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a29 expref: -99 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.776032:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa882f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.776046:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa882f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.776058:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa882f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636570.776086:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788636570.776257:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8828 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a29 expref: 20 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.776275:0:14465:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa882f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a29 expref: 19 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.776285:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636570.776287:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788636570.776291:0:14465:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fee00, rc 0) 00000100:00100000:0.0:1788636570.776361:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+19:14514:x1875520963860224:12345-192.168.203.57@tcp:101:cat.0 Request processed in 488us (729us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788636570.776369:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 33 00000100:00100000:1.0:1788636570.783110:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.784203:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963860352 00000100:00100000:0.0:1788636570.784214:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963860352 00000100:00100000:0.0:1788636570.784281:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:1.0:1788636570.784287:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.784297:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+19:2361:x1875520963860352:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636570.784313:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636570.784336:0:14451:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa882f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a29 expref: 19 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.784356:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636570.784361:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636570.784412:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+18:2361:x1875520963860352:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 120us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636570.784420:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:2.0:1788636570.784705:0:14468:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963860608 00000100:00100000:2.0:1788636570.784710:0:14468:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963860608 00000100:00100000:2.0:1788636570.784745:0:14468:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:2.0:1788636570.784753:0:14468:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+18:14514:x1875520963860608:12345-192.168.203.57@tcp:35:cat.0 00000100:00100000:2.0:1788636570.785064:0:14468:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+19:14514:x1875520963860608:12345-192.168.203.57@tcp:35:cat.0 Request processed in 311us (780us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788636570.785072:0:14468:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 8 00000100:00100000:3.0:1788636570.843788:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636570.844977:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963860864 00000100:00100000:2.0:1788636570.844994:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963860864 00000100:00100000:2.0:1788636570.845145:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:2.0:1788636570.845158:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+19:14520:x1875520963860864:12345-192.168.203.57@tcp:101:dd.0 00010000:00010000:2.0:1788636570.845209:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636570.845236:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa883d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a30 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.845372:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.845389:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 20 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.845398:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 20 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.845408:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.845452:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 20 pid: 14465 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.845467:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 20 pid: 14465 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636570.845483:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875520976430720:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636570.845623:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 20 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.845633:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 20 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636570.845656:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875520976430848:192.168.203.57@tcp:104: 00000100:00100000:2.0:1788636570.845686:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42d5a540 going to sleep for 11 seconds 00000100:00100000:1.0:1788636570.848922:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.848955:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636570.849073:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963860992 00000100:00100000:3.0:1788636570.849092:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963860992 00010000:00010000:3.0:1788636570.849142:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 21 pid: 14465 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636570.849203:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963861120 00000100:00100000:3.0:1788636570.849206:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963861120 00010000:00010000:3.0:1788636570.849220:0:14450:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 22 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636570.849235:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:3.0:1788636570.849243:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41abe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:2362:x1875520963860992:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636570.849260:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636570.849267:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 22 pid: 14465 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849282:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 22 pid: 14465 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849308:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:3.0:1788636570.849315:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849324:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849331:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636570.849387:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41abe850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:2362:x1875520963860992:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 145us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636570.849394:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:3.0:1788636570.849439:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:3.0:1788636570.849445:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+21:2362:x1875520963861120:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788636570.849457:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636570.849462:0:14450:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 21 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849472:0:14450:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 21 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849483:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:3.0:1788636570.849487:0:14450:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849495:0:14450:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849505:0:14450:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636570.849523:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788636570.849538:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+21:2362:x1875520963861120:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 93us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636570.849544:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 12 00010000:00010000:2.0:1788636570.850389:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196ae00/0xa6aa59fb12fa87f7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a14 expref: 20 pid: 14465 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636570.850411:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875520976430720:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636570.850423:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe400/0xa6aa59fb12fa87e2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a0d expref: 19 pid: 14464 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636570.850434:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875520976430848:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636570.850456:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.850466:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.850473:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636570.850496:0:14466:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788636570.850692:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa883d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a30 expref: 20 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.850708:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0e00/0xa6aa59fb12fa8844 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a30 expref: 19 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.850751:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:2.0:1788636570.850754:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788636570.850763:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c0e00, rc 0) 00000100:00100000:2.0:1788636570.850865:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+19:14520:x1875520963860864:12345-192.168.203.57@tcp:101:dd.0 Request processed in 5710us (7092us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1788636570.850872:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 34 00000100:00100000:1.0:1788636570.858717:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636570.858923:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963861376 00000100:00100000:2.0:1788636570.858935:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963861376 00000100:00100000:2.0:1788636570.859019:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 35 00000100:00100000:2.0:1788636570.859031:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+19:14520:x1875520963861376:12345-192.168.203.57@tcp:36:dd.0 00010000:00010000:2.0:1788636570.859391:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.859424:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.859438:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788636570.859499:0:14464:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1788636570.859527:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c3497c7 reply state 000000002d32d188 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636570.859538:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788636570.859657:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14520:x1875520963861376:12345-192.168.203.57@tcp:36:dd.0 Request processed in 627us (952us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1788636570.859665:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 35 00000020:00080000:2.0:1788636570.859690:0:14464:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1788636570.865064:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00010000:00010000:0.0:1788636570.865284:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.865305:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.865314:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.865321:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c1c00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636570.865329:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.865339:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.865361:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636570.865364:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636570.865370:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.865377:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1c00/0xa6aa59fb12fa8852 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636570.865869:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963861504 00000100:00100000:2.0:1788636570.865882:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963861504 00000100:00100000:2.0:1788636570.865952:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:2.0:1788636570.865965:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+21:14520:x1875520963861504:12345-192.168.203.57@tcp:101:dd.0 00010000:00010000:2.0:1788636570.866004:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636570.866030:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8859 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a37 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.866111:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8859 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a37 expref: 22 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.866127:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8859 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a37 expref: 22 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636570.866147:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:2.0:1788636570.866151:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636570.866154:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c1800, rc 0) 00000100:00100000:2.0:1788636570.866240:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81967480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14520:x1875520963861504:12345-192.168.203.57@tcp:101:dd.0 Request processed in 278us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636570.866247:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 36 00000100:00100000:3.0:1788636570.881134:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636570.881370:0:14450:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963861760 00000100:00100000:1.0:1788636570.881383:0:14450:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963861760 00000100:00100000:1.0:1788636570.881469:0:14450:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:1.0:1788636570.881480:0:14450:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14520:x1875520963861760:12345-192.168.203.57@tcp:103:dd.0 00010000:00010000:1.0:1788636570.881500:0:14450:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788636570.881532:0:14450:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1800/0xa6aa59fb12fa8859 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a37 expref: 22 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636570.881557:0:14450:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:1.0:1788636570.881564:0:14450:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788636570.881647:0:14450:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+21:14520:x1875520963861760:12345-192.168.203.57@tcp:103:dd.0 Request processed in 169us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636570.881655:0:14450:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:1.0:1788636570.884337:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.884435:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963861888 00000100:00100000:0.0:1788636570.884447:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963861888 00000100:00100000:0.0:1788636570.884521:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:0.0:1788636570.884533:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+21:14520:x1875520963861888:12345-192.168.203.57@tcp:58:dd.0 00010000:00010000:0.0:1788636570.884678:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.884700:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.884746:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788636570.885641:0:14465:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788636570.885835:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1788636570.885914:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1788636570.886065:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+21:14520:x1875520963861888:12345-192.168.203.57@tcp:58:dd.0 Request processed in 1531us (1738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636570.886076:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 37 00000100:00100000:2.0:1788636570.889098:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636570.889281:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963862016 00000100:00100000:0.0:1788636570.889293:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963862016 00000100:00100000:0.0:1788636570.889365:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 38 00000100:00100000:0.0:1788636570.889376:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+21:14520:x1875520963862016:12345-192.168.203.57@tcp:101:dd.0 00010000:00010000:0.0:1788636570.889401:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636570.889428:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8867 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a3e expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.889508:0:14464:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.889521:0:14464:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8867 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a3e expref: 22 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.889545:0:14464:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.889561:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8867 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a3e expref: 22 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.889616:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636570.889620:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788636570.889625:0:14464:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8867 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a3e expref: 22 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636570.889634:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fe000, rc 0) 00000100:00100000:0.0:1788636570.889742:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14520:x1875520963862016:12345-192.168.203.57@tcp:101:dd.0 Request processed in 368us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636570.889750:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 38 00010000:00010000:1.0:1788636571.201145:0:16586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788636571.583410:0:14495:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788636571.583418:0:14495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788636571.583452:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788636571.583458:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788636571.583575:0:14495:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a335f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14495:1875520976430976:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788636571.583734:0:14495:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d27c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636571.596586:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.596839:0:14495:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a335f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14495:1875520976430976:192.168.203.57@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788636571.597054:0:14475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963862144 00000100:00100000:3.0:1788636571.597062:0:14475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963862144 00000100:00100000:3.0:1788636571.597112:0:14475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:3.0:1788636571.597121:0:14475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14521:x1875520963862144:12345-192.168.203.57@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788636571.597204:0:14475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14521:x1875520963862144:12345-192.168.203.57@tcp:900:lhsmtool_posix.0 Request processed in 84us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.597234:0:14475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:3.0:1788636571.603246:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636571.603385:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963862272 00000100:00100000:2.0:1788636571.603399:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963862272 00000100:00100000:2.0:1788636571.603480:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:2.0:1788636571.603491:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14521:x1875520963862272:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788636571.603530:0:14466:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788636571.603695:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14521:x1875520963862272:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 205us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636571.603703:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 39 00000100:00100000:0.0:1788636571.613133:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636571.613354:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963862400 00000100:00100000:2.0:1788636571.613368:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963862400 00000100:00100000:2.0:1788636571.613446:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:2.0:1788636571.613460:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14521:x1875520963862400:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788636571.613566:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.613587:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.613601:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.613755:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.613775:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.613787:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.613848:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.613855:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.613861:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636571.614030:0:14465:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788636571.614035:0:14465:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636571.614055:0:14465:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614068:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614074:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614081:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614087:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c0000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636571.614091:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614099:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614112:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd500ebb00) 00010000:00010000:2.0:1788636571.614117:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636571.614121:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614127:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa886e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614142:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614158:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614164:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614168:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c0c00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636571.614172:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614177:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614184:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9cfd52141100) 00010000:00010000:2.0:1788636571.614187:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636571.614189:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614194:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0c00/0xa6aa59fb12fa8875 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614209:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614215:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614219:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614224:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c1000 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636571.614231:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614238:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614245:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:2.0:1788636571.614248:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788636571.614250:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.614256:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c1000/0xa6aa59fb12fa887c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636571.614724:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14521:x1875520963862400:12345-192.168.203.57@tcp:34:lhsmtool_posix.0 Request processed in 1262us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636571.614742:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 40 00000100:00100000:2.0:1788636571.617408:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.617526:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963862656 00000100:00100000:0.0:1788636571.617539:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963862656 00000100:00100000:0.0:1788636571.617613:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 41 00000100:00100000:0.0:1788636571.617625:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+22:14521:x1875520963862656:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788636571.617651:0:14464:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788636571.617677:0:14464:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa8883 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a45 expref: -99 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.617876:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.617895:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.617909:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788636571.617922:0:14464:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788636571.618059:0:14464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618068:0:14464:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618086:0:14464:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618092:0:14464:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636571.618097:0:14464:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618106:0:14464:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618122:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636571.618125:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788636571.618131:0:14464:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618150:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa888a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618203:0:14464:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa8883 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a45 expref: 24 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618215:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cfd500ebb00) 00010000:00010000:0.0:1788636571.618218:0:14464:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788636571.618222:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa8883 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a45 expref: 24 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.618233:0:14464:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd521fea00, rc 0) 00000100:00100000:0.0:1788636571.618309:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+23:14521:x1875520963862656:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 686us (918us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1788636571.618317:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 41 00000100:00100000:2.0:1788636571.626035:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.627126:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963862784 00000100:00100000:0.0:1788636571.627143:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963862784 00000100:00100000:0.0:1788636571.627402:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:0.0:1788636571.627415:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+23:14521:x1875520963862784:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788636571.627463:0:14465:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788636571.627609:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+23:14521:x1875520963862784:12345-192.168.203.57@tcp:53:lhsmtool_posix.0 Request processed in 196us (1588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.627618:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 42 00000100:00100000:2.0:1788636571.632506:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636571.632860:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963863040 00000100:00100000:3.0:1788636571.632873:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963863040 00000100:00100000:3.0:1788636571.633021:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 43 00000100:00100000:3.0:1788636571.633034:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+23:14521:x1875520963863040:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636571.633062:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636571.633143:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8898 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a4c expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788636571.636353:0:14466:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x6:0x0], count =28 00000004:00080000:3.0:1788636571.636370:0:14466:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x6:0x0]+28 in llog 00000004:00080000:3.0:1788636571.636474:0:14466:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:3.0:1788636571.637711:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa889f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.637736:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa889f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.637751:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa889f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.637862:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa8898 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a4c expref: 26 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.637886:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa889f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a4c expref: 25 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.637914:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596ce00) 00010000:00010000:3.0:1788636571.637918:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788636571.637922:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfc41990c00, rc 0) 00000100:00100000:3.0:1788636571.638101:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+25:14521:x1875520963863040:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 5069us (5608us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1788636571.638112:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 43 00000100:00100000:1.0:1788636571.642860:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.644060:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963863296 00000100:00100000:0.0:1788636571.644088:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963863296 00000100:00100000:0.0:1788636571.644215:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:0.0:1788636571.644239:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+25:14521:x1875520963863296:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788636571.644316:0:14465:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636571.644351:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990c00/0xa6aa59fb12fa889f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a4c expref: 25 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644378:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596ce00) 00010000:00010000:0.0:1788636571.644392:0:14465:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788636571.644420:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644437:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644449:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644467:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644474:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644481:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644566:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644574:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644593:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644600:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fea00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636571.644606:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644615:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644625:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cfd4596cd00) 00010000:00010000:0.0:1788636571.644628:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636571.644632:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644639:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fea00/0xa6aa59fb12fa88ad lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644650:0:14465:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644656:0:14465:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644663:0:14465:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644668:0:14465:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ff400 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636571.644671:0:14465:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644689:0:14465:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644698:0:14465:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2c057000 (ffff9cfd500eb100) 00010000:00010000:0.0:1788636571.644701:0:14465:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636571.644704:0:14465:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.644710:0:14465:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ff400/0xa6aa59fb12fa88b4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2c057000 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636571.644855:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+24:14521:x1875520963863296:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 618us (2007us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788636571.644865:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 44 00000100:00100000:2.0:1788636571.649605:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636571.649698:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963863424 00000100:00100000:3.0:1788636571.649711:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963863424 00000100:00100000:3.0:1788636571.649790:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:3.0:1788636571.650154:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+24:14521:x1875520963863424:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636571.650183:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636571.650215:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88bb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a53 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.650261:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990600/0xa6aa59fb12fa88c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.650278:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990600/0xa6aa59fb12fa88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.650292:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990600/0xa6aa59fb12fa88c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.650424:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88bb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a53 expref: 26 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.650447:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990600/0xa6aa59fb12fa88c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a53 expref: 25 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.650466:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:3.0:1788636571.650469:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788636571.650474:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfc41990600, rc 0) 00000100:00100000:3.0:1788636571.650686:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+25:14521:x1875520963863424:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 539us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.650695:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 45 00000100:00100000:1.0:1788636571.666538:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636571.667502:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963863680 00000100:00100000:3.0:1788636571.667518:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963863680 00000100:00100000:3.0:1788636571.667595:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 46 00000100:00100000:3.0:1788636571.667607:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+25:14521:x1875520963863680:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636571.667720:0:14465:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.667742:0:14465:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.667756:0:14465:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788636571.668527:0:14465:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:3.0:1788636571.668541:0:14465:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440692744525ns, next at 441692741056ns, rc = 0 00000004:00010000:3.0:1788636571.668661:0:14465:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004ffed95d reply state 00000000f6be0a68 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636571.668674:0:14465:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636571.669367:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+27:14521:x1875520963863680:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 1755us (2836us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788636571.669401:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 46 00010000:00010000:3.0:1788636571.676120:0:3266:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.676142:0:3266:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.676151:0:3266:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.676158:0:3266:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41991c00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:3.0:1788636571.676164:0:3266:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.676173:0:3266:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.676520:0:3266:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:3.0:1788636571.676525:0:3266:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788636571.676532:0:3266:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.676540:0:3266:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636571.676898:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636571.677051:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963863808 00000100:00100000:3.0:1788636571.677063:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963863808 00000100:00100000:3.0:1788636571.677387:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 47 00000100:00100000:3.0:1788636571.677400:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+26:14521:x1875520963863808:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788636571.677434:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788636571.677474:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a5a expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.677547:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 27 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.677561:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 27 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.677582:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:3.0:1788636571.677586:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788636571.677589:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfc41991800, rc 0) 00000100:00100000:3.0:1788636571.677774:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81965180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+27:14521:x1875520963863808:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 377us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.677782:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 47 00000100:00100000:1.0:1788636571.690063:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636571.690286:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963863936 00000100:00100000:2.0:1788636571.690299:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963863936 00000100:00100000:2.0:1788636571.690393:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00100000:2.0:1788636571.690407:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2361:x1875520963863936:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788636571.690895:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81964700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2361:x1875520963863936:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 490us (845us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788636571.690904:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 12 00000100:00080000:0.0:1788636571.691923:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636571.694718:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636571.695216:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963864192 00000100:00100000:1.0:1788636571.695230:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963864192 00000100:00100000:1.0:1788636571.695308:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:1.0:1788636571.695322:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+27:14521:x1875520963864192:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788636571.695639:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+28:14521:x1875520963864192:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 320us (934us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1788636571.695648:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 9 00000100:00100000:1.0:1788636571.698763:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636571.699075:0:14465:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963864448 00000100:00100000:3.0:1788636571.699089:0:14465:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963864448 00000100:00100000:3.0:1788636571.699160:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00100000:3.0:1788636571.699170:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+28:14521:x1875520963864448:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788636571.699313:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+28:14521:x1875520963864448:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 144us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.699320:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 48 00000100:00100000:3.0:1788636571.702161:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636571.702356:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963864576 00000100:00100000:2.0:1788636571.702387:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963864576 00000100:00100000:2.0:1788636571.702500:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:2.0:1788636571.702513:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+28:14521:x1875520963864576:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636571.702540:0:14466:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636571.702568:0:14466:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa88d7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a61 expref: -99 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.702661:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0800/0xa6aa59fb12fa88de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.702679:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0800/0xa6aa59fb12fa88de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.702693:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0800/0xa6aa59fb12fa88de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788636571.702742:0:14466:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788636571.702763:0:14466:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0800/0xa6aa59fb12fa88de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.702819:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0000/0xa6aa59fb12fa88d7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a61 expref: 30 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.702854:0:14466:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0800/0xa6aa59fb12fa88de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a61 expref: 29 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.702864:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:2.0:1788636571.702867:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788636571.702871:0:14466:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c0800, rc 0) 00000100:00100000:2.0:1788636571.702958:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+29:14521:x1875520963864576:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 447us (812us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636571.702980:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 49 00000100:00100000:0.0:1788636571.706574:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636571.707386:0:15148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963864704 00000100:00100000:2.0:1788636571.707400:0:15148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963864704 00000100:00100000:2.0:1788636571.707478:0:15148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:2.0:1788636571.707491:0:15148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+6:2362:x1875520963864704:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788636571.707513:0:15148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788636571.707540:0:15148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a68 expref: -99 pid: 15148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636571.707574:0:15148:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9c6d9c, blocks: 0x1 00010000:00010000:2.0:1788636571.707599:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=440s v=(0 0) 00010000:00010000:2.0:1788636571.707604:0:15148:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636571.707616:0:15148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 7 pid: 15148 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.707640:0:15148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 7 pid: 15148 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.707656:0:15148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd699c1a00, rc 0) 00000100:00100000:2.0:1788636571.708033:0:15148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:2362:x1875520963864704:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 543us (1473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636571.708042:0:15148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:1.0:1788636571.711313:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636571.711413:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963864960 00000100:00100000:2.0:1788636571.711424:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963864960 00000100:00100000:2.0:1788636571.711539:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:2.0:1788636571.711552:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd81966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+29:14521:x1875520963864960:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788636571.711752:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd81966a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+29:14521:x1875520963864960:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 201us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636571.711761:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 50 00000100:00100000:0.0:1788636571.715544:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636571.715669:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963865088 00000100:00100000:2.0:1788636571.715682:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963865088 00000100:00100000:2.0:1788636571.715782:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 51 00000100:00100000:2.0:1788636571.715826:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+29:14521:x1875520963865088:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788636571.830949:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1788636571.831114:0:5832:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1788636571.831147:0:5832:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1788636571.831463:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:14521:x1875520963865088:12345-192.168.203.57@tcp:44:lhsmtool_posix.0 Request processed in 115661us (115928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.831478:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 51 00000100:00100000:3.0:1788636571.831535:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976431104:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788636571.831629:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788636571.834638:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976431104 00000100:00100000:1.0:1788636571.834658:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976431104 00000100:00100000:1.0:1788636571.834735:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788636571.834748:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976431104:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788636571.835061:0:15876:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1788636571.835066:0:15876:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1788636571.835068:0:15876:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788636571.835070:0:15876:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788636572 -> 1788636572 00002000:00010000:1.0:1788636571.835073:0:15876:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788636571.835174:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3280:x1875520976431104:12345-0@lo:2:osp-syn-0-0.0 Request processed in 428us (3544us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788636571.835183:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788636571.835771:0:3280:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cfd7f92e680/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788636571.835780:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976431104:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788636571.836460:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.836601:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963865216 00000100:00100000:0.0:1788636571.836611:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963865216 00000100:00100000:0.0:1788636571.836674:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:0.0:1788636571.836685:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:2363:x1875520963865216:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788636571.836833:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f92ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:2363:x1875520963865216:12345-192.168.203.57@tcp:16:lhsmtool_posix.0 Request processed in 149us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.836841:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:2.0:1788636571.841047:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636571.841277:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963865472 00000100:00100000:3.0:1788636571.841290:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963865472 00000100:00100000:3.0:1788636571.841376:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 52 00000100:00100000:3.0:1788636571.841389:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:14521:x1875520963865472:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788636571.841457:0:14464:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788636571.841489:0:14464:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd699c0800/0xa6aa59fb12fa88de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a61 expref: 14 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.841515:0:14464:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:3.0:1788636571.841520:0:14464:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788636571.841561:0:14464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.841578:0:14464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.841589:0:14464:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788636571.841934:0:14464:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bcc6a225 reply state 00000000b8af30d9 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636571.841946:0:14464:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788636571.844492:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+15:14521:x1875520963865472:12345-192.168.203.57@tcp:36:lhsmtool_posix.0 Request processed in 3089us (3442us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1788636571.844509:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 52 00010000:00010000:0.0:1788636571.851974:0:3267:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.852032:0:3267:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.852041:0:3267:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.852048:0:3267:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41991c00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636571.852055:0:3267:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.852064:0:3267:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.852096:0:3267:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:0.0:1788636571.852100:0:3267:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636571.852106:0:3267:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.852113:0:3267:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991c00/0xa6aa59fb12fa88ec lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14464 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636571.855676:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636571.856428:0:15876:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963865600 00000100:00100000:1.0:1788636571.856442:0:15876:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963865600 00000100:00100000:1.0:1788636571.856578:0:15876:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:1.0:1788636571.856591:0:15876:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:14521:x1875520963865600:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788636571.856614:0:15876:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788636571.856643:0:15876:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb982844835155a6f expref: -99 pid: 15876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.856682:0:15876:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 8 pid: 15148 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.856692:0:15876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636571.856697:0:15876:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636571.856703:0:15876:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 8 pid: 15876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.856749:0:15876:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 8 pid: 15148 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.856765:0:15876:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 8 pid: 15148 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636571.856814:0:15876:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd7f92f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15876:1875520976431232:192.168.203.57@tcp:104: 00000100:00100000:1.0:1788636571.856941:0:15876:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd471c4900 going to sleep for 11 seconds 00000100:00100000:1.0:1788636571.861642:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.861860:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963865728 00000100:00100000:0.0:1788636571.861873:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963865728 00010000:00010000:0.0:1788636571.861926:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 9 pid: 15148 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636571.861984:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:0.0:1788636571.861996:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:2363:x1875520963865728:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636571.862014:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636571.862065:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 9 pid: 15148 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.862090:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 9 pid: 15148 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.862122:0:14451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636571.862126:0:14451:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788636571.862135:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 9 pid: 15876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.862147:0:14451:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 9 pid: 15876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.862197:0:14451:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 9 pid: 15876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636571.862216:0:14451:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14451:1875520976431360:192.168.203.57@tcp:105: 00010000:00010000:2.0:1788636571.862495:0:15876:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e9beeee/0xa6aa59fb12fa88e5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a68 expref: 9 pid: 15148 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636571.862513:0:15876:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd7f92f100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:15876:1875520976431232:192.168.203.57@tcp:104: 00010000:00010000:2.0:1788636571.862543:0:15876:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 8 pid: 15876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.862555:0:15876:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cfd8196aa00, rc 0) 00000100:00100000:0.0:1788636571.862753:0:14451:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d27c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788636571.863118:0:15876:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+8:14521:x1875520963865600:12345-192.168.203.57@tcp:101:lhsmtool_posix.0 Request processed in 6527us (7455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636571.863139:0:15876:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:3.0:1788636571.866581:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.868061:0:14451:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:14451:1875520976431360:192.168.203.57@tcp:105: 00010000:00010000:0.0:1788636571.868163:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636571.868290:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:2363:x1875520963865728:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 6295us (6659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.868310:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 13 00000100:00100000:0.0:1788636571.868363:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963865856 00000100:00100000:0.0:1788636571.868372:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963865856 00000100:00100000:0.0:1788636571.868451:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:0.0:1788636571.868470:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:2362:x1875520963865856:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788636571.868721:0:15145:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788636571.868739:0:15145:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788636571 00002000:00010000:0.0:1788636571.868743:0:15145:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788636570 00002000:00010000:0.0:1788636571.868745:0:15145:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788636572 -> 1788636571 00002000:00010000:0.0:1788636571.868748:0:15145:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788636571.868776:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+8:2362:x1875520963865856:12345-192.168.203.57@tcp:2:lhsmtool_posix.0 Request processed in 316us (2211us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788636571.868784:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:2.0:1788636571.872285:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636571.872431:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963865984 00000100:00100000:3.0:1788636571.872524:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963865984 00000100:00100000:3.0:1788636571.872957:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:3.0:1788636571.872978:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+8:2361:x1875520963865984:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788636571.873039:0:15146:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.873063:0:15146:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 8 pid: 15876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.873084:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636571.873089:0:15146:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788636571.873095:0:15146:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.873143:0:15146:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 8 pid: 15876 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.873159:0:15146:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 8 pid: 15876 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636571.873176:0:15146:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15146:1875520976431488:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636571.873285:0:15146:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5a0c7480 going to sleep for 11 seconds 00000100:00100000:3.0:1788636571.877329:0:15146:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15146:1875520976431488:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636571.877372:0:15146:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636571.879660:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.879774:0:14449:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963866112 00000100:00100000:0.0:1788636571.879786:0:14449:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963866112 00010000:00010000:0.0:1788636571.879878:0:14449:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 9 pid: 15876 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636571.880082:0:14449:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 14 00000100:00100000:0.0:1788636571.880095:0:14449:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:2362:x1875520963866112:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636571.880117:0:14449:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636571.880148:0:14449:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 9 pid: 15876 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.880164:0:14449:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 9 pid: 15876 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.880192:0:14449:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa88f3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.57@tcp remote: 0xb982844835155a6f expref: 9 pid: 15876 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.880232:0:14449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636571.880237:0:14449:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788636571.880245:0:14449:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.880257:0:14449:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.880297:0:14449:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636571.880539:0:14449:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+8:2362:x1875520963866112:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 445us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.880547:0:14449:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 14 00010000:00010000:3.0:1788636571.880631:0:15146:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.880642:0:15146:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.880671:0:15146:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.880680:0:15146:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.880689:0:15146:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.880697:0:15146:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990e00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636571.880702:0:15146:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.880713:0:15146:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.880740:0:15146:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.880761:0:15146:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b15f3367/0xa6aa59fb12fa88fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15146 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636571.880868:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:2361:x1875520963865984:12345-192.168.203.57@tcp:1:lhsmtool_posix.0 Request processed in 7894us (8596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636571.880877:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:1.0:1788636571.885195:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636571.885408:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963866368 00000100:00100000:3.0:1788636571.885421:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963866368 00000100:00100000:3.0:1788636571.885502:0:14466:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 53 00000100:00100000:3.0:1788636571.885516:0:14466:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:14521:x1875520963866368:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788636571.885622:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.885644:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.885659:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.886259:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.886276:0:14466:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 15 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.886287:0:14466:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.886344:0:14466:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 15 pid: 14466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.886363:0:14466:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 15 pid: 14466 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636571.886381:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875520976431616:192.168.203.57@tcp:104: 00000100:00100000:3.0:1788636571.886556:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd5d2810c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788636571.891171:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:0.0:1788636571.891673:0:14451:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963866496 00000100:00100000:0.0:1788636571.891687:0:14451:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963866496 00010000:00010000:0.0:1788636571.891744:0:14451:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 16 pid: 14466 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636571.891839:0:14451:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 15 00000100:00100000:0.0:1788636571.891851:0:14451:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+16:2362:x1875520963866496:12345-192.168.203.57@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788636571.891871:0:14451:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788636571.891879:0:14451:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 16 pid: 14466 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.891906:0:14451:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 16 pid: 14466 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.891960:0:14451:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:0.0:1788636571.891976:0:14451:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.891988:0:14451:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.891998:0:14451:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.892024:0:14451:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788636571.892095:0:14451:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+16:2362:x1875520963866496:12345-192.168.203.57@tcp:103:ldlm_bl.0 Request processed in 246us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636571.892103:0:14451:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 15 00010000:00010000:3.0:1788636571.893188:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41991800/0xa6aa59fb12fa88d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.57@tcp remote: 0xb982844835155a5a expref: 15 pid: 14466 timeout: 540 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636571.893211:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875520976431616:192.168.203.57@tcp:104: 00010000:00010000:3.0:1788636571.893239:0:14466:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.893250:0:14466:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636571.893256:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636571.893632:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1788636571.893878:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1788636571.894061:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1788636571.894229:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd69b70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14466:1875520976431744:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788636571.894549:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636571.894675:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd48eb7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788636571.895738:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976431744 00000100:00100000:2.0:1788636571.895753:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976431744 00000100:00100000:2.0:1788636571.895854:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788636571.895866:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1875520976431744:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788636571.896033:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1875520976431744:12345-0@lo:1000:mdt00_002.0 Request processed in 169us (1491us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636571.896041:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788636571.896789:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd69b70e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14466:1875520976431744:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788636571.899207:0:14466:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1788636571.899334:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14466:1875520976431872:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788636571.900054:0:14466:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636571.900242:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42d5a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788636571.900672:0:14469:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976431872 00000100:00100000:3.0:1788636571.900686:0:14469:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976431872 00000100:00100000:3.0:1788636571.900744:0:14469:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788636571.900754:0:14469:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14466:x1875520976431872:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788636571.902389:0:14469:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14466:x1875520976431872:12345-0@lo:1000:mdt00_002.0 Request processed in 1630us (2331us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788636571.902402:0:14469:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788636571.903008:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14466:1875520976431872:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1788636571.903087:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903101:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903110:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903117:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990e00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636571.903122:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903154:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903175:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:2.0:1788636571.903178:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636571.903184:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903191:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990e00/0xa6aa59fb12fa8908 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903233:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903239:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903245:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903249:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521fee00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:2.0:1788636571.903252:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903258:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903266:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:2.0:1788636571.903268:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788636571.903277:0:14466:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8867 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a3e expref: 18 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903314:0:14466:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8867 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a3e expref: 18 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903326:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8867 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a3e expref: 18 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.903405:0:14466:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fe000/0xa6aa59fb12fa8867 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.57@tcp remote: 0xb982844835155a3e expref: 18 pid: 14464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636571.903422:0:14466:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875520976432000:192.168.203.57@tcp:105: 00000100:00100000:2.0:1788636571.903539:0:14466:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cfd42d5a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788636571.910999:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636571.911110:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963866624 00000100:00100000:1.0:1788636571.911125:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963866624 00000100:00100000:1.0:1788636571.911226:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:1.0:1788636571.911237:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7f97e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+19:14520:x1875520963866624:12345-192.168.203.57@tcp:49:dd.0 00000100:00100000:1.0:1788636571.911407:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7f97e850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+19:14520:x1875520963866624:12345-192.168.203.57@tcp:49:dd.0 Request processed in 172us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788636571.911415:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 10 00000100:00100000:0.0:1788636571.911615:0:14466:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14466:1875520976432000:192.168.203.57@tcp:105: 00010000:00010000:0.0:1788636571.911652:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911665:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521fee00/0xa6aa59fb12fa8860 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14465 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911713:0:14466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911733:0:14466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911747:0:14466:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911776:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911785:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911793:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911847:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd521ffe00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636571.911852:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911860:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.911877:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636571.911882:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788636571.911887:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.912041:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd521ffe00/0xa6aa59fb12fa890f lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.912056:0:14466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.912063:0:14466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.912070:0:14466:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.912082:0:14466:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41990a00 already unused, calling callback (ffffffffc220d4f0) 00010000:00010000:0.0:1788636571.912085:0:14466:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.912092:0:14466:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.912101:0:14466:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cfd500eb200) 00010000:00010000:0.0:1788636571.912104:0:14466:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788636571.912107:0:14466:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636571.912113:0:14466:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfc41990a00/0xa6aa59fb12fa8901 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14466 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788636571.912717:0:14495:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788636571.912723:0:14495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636571.912755:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788636571.912761:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788636571.913060:0:14466:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+18:14521:x1875520963866368:12345-192.168.203.57@tcp:57:lhsmtool_posix.0 Request processed in 27542us (27874us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788636571.913072:0:14466:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 53 00000020:00080000:0.0:1788636571.913079:0:14466:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788636571.915438:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636571.915582:0:14467:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963866880 00000100:00100000:1.0:1788636571.915592:0:14467:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963866880 00000100:00100000:1.0:1788636571.915713:0:14467:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 11 00000100:00100000:1.0:1788636571.915725:0:14467:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+18:14521:x1875520963866880:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788636571.917390:0:14467:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788636571.917516:0:14467:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1788636571.917573:0:14467:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.917591:0:14467:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.917603:0:14467:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.917686:0:14467:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.917693:0:14467:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.917700:0:14467:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636571.917724:0:14467:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788636571.917980:0:14467:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+20:14521:x1875520963866880:12345-192.168.203.57@tcp:35:lhsmtool_posix.0 Request processed in 2254us (2548us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1788636571.917990:0:14467:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 11 00000020:00080000:1.0:1788636571.917996:0:14467:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788636571.918577:0:14452:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788636571.918585:0:14452:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.918593:0:14452:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636571.918597:0:14452:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.918614:0:14452:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.918641:0:14452:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cfd4596c700) 00010000:00010000:2.0:1788636571.918644:0:14452:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788636571.918649:0:14452:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.918655:0:14452:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cfd8196b200/0xa6aa59fb12fa8916 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14467 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636571.918667:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636571.918669:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788636571.918671:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636572.136310:0:3273:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636572.136440:0:15151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963867008 00000100:00100000:1.0:1788636572.136449:0:15151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963867008 00000100:00100000:1.0:1788636572.136517:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:1.0:1788636572.136528:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfc41c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+7:2362:x1875520963867008:12345-192.168.203.57@tcp:4:dd.0 00002000:00010000:1.0:1788636572.136576:0:15151:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9c6d9b, atime: 0x6a9c6d9a, ctime: 0x6a9c6d9b, blocks: 0x1 00010000:00010000:1.0:1788636572.136585:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.136600:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=441s v=(0 0) 00010000:00010000:1.0:1788636572.136605:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636572.136612:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.136638:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636572.137824:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636572.137969:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:1.0:1788636572.138303:0:15153:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788636572.138313:0:15153:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788636572.138696:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963867136 00000100:00100000:1.0:1788636572.138705:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963867136 00000100:00100000:1.0:1788636572.138745:0:15153:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788636572.138751:0:15153:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963867264 00000100:00100000:1.0:1788636572.138754:0:15153:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963867264 00000100:00100000:2.0:1788636572.142336:0:16699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 1 00000100:00100000:2.0:1788636572.142352:0:16699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+10:2362:x1875520963867136:12345-192.168.203.57@tcp:4:dd.0 00010000:00010000:2.0:1788636572.142391:0:16699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.142408:0:16699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.142412:0:16699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.142419:0:16699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.142432:0:16699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788636572.190194:0:15151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:3.0:1788636572.190204:0:15151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1788636571 -> 1788636572 00002000:00010000:3.0:1788636572.190208:0:15151:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:3.0:1788636572.190224:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636572.190238:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636572.190247:0:15151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636572.190254:0:15151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196b200 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:3.0:1788636572.190259:0:15151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636572.190287:0:15151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636572.190307:0:15151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636572.190315:0:15151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fc165267/0xa6aa59fb12fa891d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788636572.190401:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfc41c58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+14:2362:x1875520963867008:12345-192.168.203.57@tcp:4:dd.0 Request processed in 53871us (54097us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1788636572.190429:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 0 00000100:00100000:3.0:1788636572.190461:0:15151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:3.0:1788636572.190474:0:15151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+13:2363:x1875520963867264:12345-192.168.203.57@tcp:4:dd.0 00010000:00010000:3.0:1788636572.190505:0:15151:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636572.190518:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636572.190523:0:15151:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788636572.190529:0:15151:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788636572.190541:0:15151:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636572.191072:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00000001:00080000:0.0:1788636572.191086:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00000001:00080000:0.0:1788636572.191095:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:0.0:1788636572.191104:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00010000:00010000:1.0:1788636572.224079:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788636572.233978:0:16699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:0.0:1788636572.233988:0:16699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 6151 00010000:00010000:0.0:1788636572.234003:0:16699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.234016:0:16699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.234035:0:16699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.234043:0:16699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c0800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636572.234048:0:16699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.234058:0:16699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.234077:0:16699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.234084:0:16699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8924 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636572.234394:0:16699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f6ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+11:2362:x1875520963867136:12345-192.168.203.57@tcp:4:dd.0 Request processed in 92040us (96569us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788636572.234411:0:16699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 1 00000001:00080000:0.0:1788636572.234709:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:2.0:1788636572.283728:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00010000:00010000:1.0:1788636572.284008:0:15151:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.284037:0:15151:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.284047:0:15151:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.284054:0:15151:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfc41991800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636572.284059:0:15151:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.284186:0:15151:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.284207:0:15151:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.284280:0:15151:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e6fc40b/0xa6aa59fb12fa892b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15151 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636572.284382:0:15151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2363:x1875520963867264:12345-192.168.203.57@tcp:4:dd.0 Request processed in 93909us (146419us total) trans 8589934600 rc 0/0 00000100:00100000:1.0:1788636572.284393:0:15151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 2 00000100:00100000:2.0:1788636572.288911:0:3280:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788636572.288934:0:3280:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd756a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976432128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788636572.289033:0:3280:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636572.289344:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976432128 00000100:00100000:2.0:1788636572.289352:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976432128 00000100:00100000:2.0:1788636572.289406:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788636572.289415:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976432128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788636572.289449:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788636572.289496:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3280:x1875520976432128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636572.289503:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788636572.289524:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788636572.289561:0:3280:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd756a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3280:1875520976432128:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788636572.289721:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976432384:0@lo:400:kworker.0 00000100:00100000:0.0:1788636572.289768:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636572.289790:0:3283:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788636572.289982:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3283:1875520976432256:0@lo:400:kworker.0 00000100:00100000:0.0:1788636572.290014:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636572.290050:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976432768:0@lo:400:kworker.0 00000100:00100000:0.0:1788636572.290203:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788636572.290305:0:15145:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976432384 00000100:00100000:0.0:1788636572.290310:0:15145:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976432384 00000100:00100000:0.0:1788636572.290349:0:15145:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788636572.290357:0:15145:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976432384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636572.290397:0:15145:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a336a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976432384:12345-0@lo:400:kworker.0 Request processed in 42us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636572.290404:0:15145:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788636572.290423:0:14457:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976432256 00000100:00100000:0.0:1788636572.290427:0:14457:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976432256 00000100:00100000:0.0:1788636572.290450:0:14457:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788636572.290457:0:14457:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3283:x1875520976432256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636572.290487:0:14457:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c8fa81e7-22d5-4023-a9dc-119f1fc21189+19:3283:x1875520976432256:12345-0@lo:400:kworker.0 Request processed in 32us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636572.290494:0:14457:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788636572.290520:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976432768 00000100:00100000:0.0:1788636572.290523:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976432768 00000100:00100000:0.0:1788636572.290548:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788636572.290554:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6a334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976432768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788636572.290579:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6a334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3283:x1875520976432768:12345-0@lo:400:kworker.0 Request processed in 26us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636572.290584:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788636572.290612:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c8fa81e7-22d5-4023-a9dc-119f1fc21189:3283:1875520976432256:0@lo:400:kworker.0 00000100:00100000:0.0:1788636572.290621:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a335880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3283:1875520976432768:0@lo:400:kworker.0 00000100:00100000:0.0:1788636572.290628:0:3283:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1788636572.290638:0:3283:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cfd7f92e680, transno 8589934595 00000004:00080000:0.0:1788636572.290655:0:3283:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1788636572.290672:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a337800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976432384:0@lo:400:kworker.0 00000100:00100000:3.0:1788636572.290915:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976432640:0@lo:400:kworker.0 00000100:00100000:3.0:1788636572.290948:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788636572.290986:0:3281:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788636572.290993:0:3281:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfd6a335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976432512:0@lo:400:kworker.0 00000100:00100000:3.0:1788636572.291015:0:3281:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788636572.291933:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636572.291941:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788636572.292924:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976432640 00000100:00100000:0.0:1788636572.292935:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976432640 00000100:00080000:2.0:1788636572.293073:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788636572.293177:0:14466:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976432512 00000100:00100000:0.0:1788636572.293182:0:14466:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976432512 00000100:00100000:3.0:1788636572.301712:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636572.301732:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875520976432640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636572.301973:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3281:x1875520976432640:12345-0@lo:400:kworker.0 Request processed in 237us (11011us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636572.301980:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788636572.302004:0:14465:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636572.302012:0:14465:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976432512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788636572.302045:0:14465:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3281:x1875520976432512:12345-0@lo:400:kworker.0 Request processed in 34us (11029us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636572.302051:0:14465:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788636572.302177:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a335c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3281:1875520976432512:0@lo:400:kworker.0 00000100:00100000:3.0:1788636572.302204:0:3281:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfd6a334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3281:1875520976432640:0@lo:400:kworker.0 00000100:00100000:2.0:1788636572.302392:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636572.302429:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636572.302450:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636572.302468:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636572.302487:0:3275:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:2.0:1788636572.302506:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963867392 00000100:00100000:2.0:1788636572.302513:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963867392 00000100:00100000:2.0:1788636572.302549:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963867648 00000100:00100000:2.0:1788636572.302552:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963867648 00000100:00100000:2.0:1788636572.302565:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963867904 00000100:00100000:2.0:1788636572.302568:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963867904 00000100:00100000:2.0:1788636572.302578:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963867520 00000100:00100000:2.0:1788636572.302581:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963867520 00000100:00100000:2.0:1788636572.302592:0:15152:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963867776 00000100:00100000:2.0:1788636572.302594:0:15152:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963867776 00000100:00100000:2.0:1788636572.302628:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:2.0:1788636572.302634:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:2363:x1875520963867392:12345-192.168.203.57@tcp:4:dd.0 00002000:00010000:2.0:1788636572.302674:0:15152:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 3145728, mtime: 0x6a9c6d9c, atime: 0x6a9c6d9a, ctime: 0x0, blocks: 0x1807 00010000:00010000:2.0:1788636572.302683:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.302698:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=441s v=(0 0) 00010000:00010000:2.0:1788636572.302702:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.302707:0:15152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.302720:0:15152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636572.303015:0:16699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:2.0:1788636572.303024:0:16699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+10:2363:x1875520963867648:12345-192.168.203.57@tcp:4:dd.0 00010000:00010000:2.0:1788636572.303041:0:16699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.303051:0:16699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.303054:0:16699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.303058:0:16699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.303067:0:16699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788636572.384368:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00002000:00010000:1.0:1788636572.384574:0:15152:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 6291456 00002000:00010000:1.0:1788636572.384579:0:15152:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 0 -> 1788636572 00002000:00010000:1.0:1788636572.384581:0:15152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1788636572.384606:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.384618:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.384628:0:15152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.384635:0:15152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c0600 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:1.0:1788636572.384640:0:15152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.384650:0:15152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.384669:0:15152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.384676:0:15152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d63748a9/0xa6aa59fb12fa8932 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788636572.384755:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+12:2363:x1875520963867392:12345-192.168.203.57@tcp:4:dd.0 Request processed in 82117us (82362us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1788636572.384766:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 3 00000100:00100000:1.0:1788636572.384793:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:1.0:1788636572.384846:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+11:2363:x1875520963867904:12345-192.168.203.57@tcp:4:dd.0 00010000:00010000:1.0:1788636572.384884:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.384953:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636572.384970:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788636572.384977:0:15152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788636572.384990:0:15152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788636572.444500:0:16699:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7654321 00002000:00010000:2.0:1788636572.444510:0:16699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1788636572.444524:0:16699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.444538:0:16699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.444547:0:16699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.444554:0:16699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c1c00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636572.444559:0:16699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.444568:0:16699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.444587:0:16699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.444594:0:16699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa8939 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636572.444680:0:16699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+13:2363:x1875520963867648:12345-192.168.203.57@tcp:4:dd.0 Request processed in 141653us (142246us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1788636572.444703:0:16699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 4 00000100:00100000:2.0:1788636572.444732:0:16699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 6 00000100:00100000:2.0:1788636572.444743:0:16699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+12:2363:x1875520963867520:12345-192.168.203.57@tcp:4:dd.0 00010000:00010000:2.0:1788636572.444776:0:16699:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.444788:0:16699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.444792:0:16699:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.444903:0:16699:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.444918:0:16699:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788636572.446189:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:1.0:1788636572.498844:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00002000:00010000:2.0:1788636572.505328:0:15152:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:2.0:1788636572.505348:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.505361:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.505370:0:15152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.505378:0:15152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd8196aa00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:2.0:1788636572.505383:0:15152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.505403:0:15152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.505423:0:15152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.505430:0:15152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b1cb8c8/0xa6aa59fb12fa8940 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788636572.505563:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+10:2363:x1875520963867904:12345-192.168.203.57@tcp:4:dd.0 Request processed in 120716us (203107us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788636572.505574:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 5 00000100:00100000:2.0:1788636572.505609:0:15152:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 7 00000100:00100000:2.0:1788636572.505623:0:15152:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd69b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:2363:x1875520963867776:12345-192.168.203.57@tcp:4:dd.0 00010000:00010000:2.0:1788636572.505655:0:15152:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.505667:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.505672:0:15152:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788636572.505678:0:15152:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788636572.505690:0:15152:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788636572.560251:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:0.0:1788636572.561330:0:16699:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1788636572.561353:0:16699:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.561367:0:16699:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.561377:0:16699:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.561385:0:16699:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c0800 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636572.561392:0:16699:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.561403:0:16699:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.561426:0:16699:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.561451:0:16699:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c92c18f8/0xa6aa59fb12fa8947 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16699 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636572.561563:0:16699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd756a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+9:2363:x1875520963867520:12345-192.168.203.57@tcp:4:dd.0 Request processed in 116819us (259088us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788636572.561573:0:16699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 6 00000001:00080000:1.0:1788636572.575760:0:6685:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00010000:00010000:0.0:1788636572.575867:0:15152:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.575883:0:15152:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.575893:0:15152:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.575901:0:15152:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cfd699c1c00 already unused, calling callback (ffffffffc17fe4f0) 00010000:00010000:0.0:1788636572.575906:0:15152:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.575917:0:15152:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.575935:0:15152:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788636572.575976:0:15152:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a09a3df9/0xa6aa59fb12fa894e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15152 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788636572.576119:0:15152:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd69b70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2363:x1875520963867776:12345-192.168.203.57@tcp:4:dd.0 Request processed in 70494us (273623us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788636572.576130:0:15152:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 7 00000040:00080000:2.0:1788636572.927108:0:14495:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788636572.927117:0:14495:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788636572.927150:0:14495:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788636572.927156:0:14495:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1788636573.247824:0:16585:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636573.262168:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636573.262212:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636573.262252:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636573.262282:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636573.262304:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636573.262338:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636573.262357:0:3274:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.57@tcp (source: 12345-192.168.203.57@tcp) 00000100:00100000:3.0:1788636573.262383:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963868288 00000100:00100000:3.0:1788636573.262404:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963868288 00000100:00100000:3.0:1788636573.262452:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963868800 00000100:00100000:3.0:1788636573.262456:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963868800 00000100:00100000:3.0:1788636573.262468:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963868416 00000100:00100000:3.0:1788636573.262471:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963868416 00000100:00100000:3.0:1788636573.262483:0:15146:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963868672 00000100:00100000:3.0:1788636573.262485:0:15146:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963868672 00000100:00100000:3.0:1788636573.262498:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:3.0:1788636573.262507:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2361:x1875520963868288:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636573.262570:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2361:x1875520963868288:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 63us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636573.262578:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 16 00000100:00100000:3.0:1788636573.262593:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:3.0:1788636573.262852:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2361:x1875520963868800:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636573.262895:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2361:x1875520963868800:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 35us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636573.262901:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 17 00000100:00100000:3.0:1788636573.262912:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:3.0:1788636573.262918:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2361:x1875520963868416:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:3.0:1788636573.262939:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5de680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+5:2361:x1875520963868416:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 20us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636573.262944:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 18 00000100:00100000:3.0:1788636573.262967:0:15146:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:3.0:1788636573.262984:0:15146:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2361:x1875520963868672:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636573.263164:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963868544 00000100:00100000:0.0:1788636573.263169:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963868544 00000100:00100000:0.0:1788636573.263199:0:14464:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963868160 00000100:00100000:0.0:1788636573.263201:0:14464:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963868160 00000100:00100000:0.0:1788636573.263215:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 29 00000100:00100000:0.0:1788636573.263221:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd612c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2361:x1875520963868544:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636573.263254:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd612c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:61f30443-f7d9-4279-b5c2-d68139438f4b+6:2361:x1875520963868544:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 33us (1001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636573.263260:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 29 00000100:00100000:0.0:1788636573.263272:0:14464:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:0.0:1788636573.263278:0:14464:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+20:2361:x1875520963868160:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:0.0:1788636573.263302:0:14464:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4a21948e-2331-47c0-8be3-5e0fad8d2f7a+20:2361:x1875520963868160:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 24us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788636573.263308:0:14464:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 30 00000100:00100000:3.0:1788636573.269559:0:15146:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:61f30443-f7d9-4279-b5c2-d68139438f4b+5:2361:x1875520963868672:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 33us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1788636573.269587:0:15146:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 19 00000100:00100000:2.0:1788636573.269973:0:14459:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520963868032 00000100:00100000:2.0:1788636573.269984:0:14459:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520963868032 00000100:00100000:2.0:1788636573.270052:0:14459:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.57@tcp, seq: 122 00000100:00100000:2.0:1788636573.270064:0:14459:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd7fa0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+13:2361:x1875520963868032:12345-192.168.203.57@tcp:400:kworker.0 00000100:00100000:2.0:1788636573.270130:0:14459:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd7fa0a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41e3de15-0175-4e7c-8623-04ef993a057c+13:2361:x1875520963868032:12345-192.168.203.57@tcp:400:kworker.0 Request processed in 69us (7973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636573.270137:0:14459:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.57@tcp, seq: 122 00000100:00080000:2.0:1788636573.270170:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788636573.270176:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788636573.270179:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788636574.277325:0:16586:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788636574.480374:0:16737:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788636575.295159:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788636575.872624:0:3283:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cfc43851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976432896:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788636575.872739:0:3283:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788636575.872985:0:15149:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875520976432896 00000100:00100000:2.0:1788636575.872999:0:15149:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875520976432896 00000100:00100000:2.0:1788636575.873294:0:15149:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788636575.873307:0:15149:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9cfd6f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976432896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788636575.873353:0:15149:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 6815744 granted 62980096 pending 0 free 3851419648 avail 3849322496 00000100:00080000:3.0:1788636575.873453:0:14460:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788636575.884338:0:15149:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9cfd6f5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3283:x1875520976432896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 11015us (11580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788636575.884360:0:15149:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788636575.888178:0:3283:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cfc43851500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3283:1875520976432896:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788636576.323247:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29608 lines, 29608 kept, 0 dropped, 0 bad.